Summer School Applied Mathematics: Optimization for Machine Learning
- Summer School
- Study field
Mathematics - Institution
INSA TOULOUSE
With 14,000 alumni working in all economic sectors, the "Institut National des Sciences Appliquées" of Toulouse is an international and multidisciplinary state engineering school recognized for the excellence of its five-year education, which attracts students of a high academic level. INSA-Toulouse offersa wide range of engineering specializations, including computer science, civil engineering, mathematical engineering and biochemical engineering. Its courses, designed with the latest scientific advancements in mind, are supported through the activity of leading-edge research laboratories, backed by some of the largest industrial groups.
- Teaching language
English
Overview
Presentation
This 2-week summer school will focus on optimization for machine learning.
Dates : June, 3rd -14th, 2019
The summer school takes place on INSA Campus in Toulouse.
The aim of this series of Lectures is to provide the basic background for dealing with Optimization issues in deterministic and stochastic environment.
More specifically, we address the main features of smooth optimization algorithms with and without constraints : in addition to the theoretical material, we describe deterministic and stochastic gradient algorithms, Newton-type algorithms, least square algorithms. This part will be completed by an introduction to nonsmooth optimization algorithms (sub gradient algorithms and proximal algorithms). All these optimization algorithms will be implemented during practice classes with application to image processing. The second part of the Lectures will be devoted to actual Statistical issues related to Machine Learning.
Course details
Training content
Learning objectives
- To be able to choose and implement a suitable algorithm for solving a given optimization problem, especially in the context of machine learning.
Contents
- Optimality conditions
- Algorithms for differentiable optimization without constraints
- Gradient algorithms
- Stochastic gradient algorithm
- Newton-type algorithms
- Least squares issues
- First algorithms for nondifferentiable optimization - LASSO, proximal algorithm.
- Introduction to Statistical Learning: Ridge Regression, Lasso, Support Vector Machines
- Imaging applications: image registration, compressive sampling, dictionary training, ...
Admission
Access condition
This program is dedicated to students having a L3 or M1 degree.
Deadline registration : March 18th, 2019
Prerequisites
Differential calculus, basics in statistics.
Application must be made directly to the organizing institution. No application is possible through this website. Please click on the link "See the course website" to find out how to apply.
About School
INSA TOULOUSE
With 14,000 alumni working in all economic sectors, the "Institut National des Sciences Appliquées" of Toulouse is an international and multidisciplinary state engineering school recognized for the excellence of its five-year education, which attracts students of a high academic level. INSA-Toulouse offersa wide range of engineering specializations, including computer science, civil engineering, mathematical engineering and biochemical engineering. Its courses, designed with the latest scientific advancements in mind, are supported through the activity of leading-edge research laboratories, backed by some of the largest industrial groups.