Representation Learning (MVA)

Title: Representation Learning for Computer Vision and Medical Imaging

Instructors: Pietro Gori and Loïc Le Folgoc

Objectives and Topics: Good and expressive data representations can improve the accuracy of machine learning problems and ease interpretability and transfer. For computer vision and medical imaging tasks, handcrafting good data representations, a.k.a. feature engineering, was traditionally hard. Deep Learning has changed this paradigm by allowing the automatic discovery of good representations from data. This is known as representation learning. The objective of this course is to provide an introduction to representation learning in computer vision and medical imaging applications. We will cover the following topics:

• Representation Learning
• Transfer Learning
• Domain Adaptation
• Multi-task Learning
• Knowledge Distillation
• Self-Supervised Learning and Foundation models
• Attention and Transformers
• Disentangled Representations using Generative Models
• Uncertainty, Interpretability and Explainability in Neural Networks

Validation: Grading will be based on the practical session reports (50%) and written or oral exam (depending on the number of students) (50%).

Language: English or French (depending on the audience)

Organization: 8 lectures divided into 1,5h of theory and 1,5h of practical session + 1 session of exam

Location: All lectures and practical sessions will be held at Télécom Paris. Please bring your own laptop

Lectures:

Date Time Title Type Room Instructor
12/01/2025 13:30-16:45 Introduction + Transfer Learning Cours + TP + Intro Pytorch + Rendu Amphi Dieng + 1A207 1A226 P. Gori
19/01/2025 13:30-16:45 Domain Adaptation + Multitask Learning + Knowledge Distillation Cours + TP + Paper + Rendu Amphi Dieng + 1A260 P. Gori
26/01/2025 13:30-16:45 Self-Supervised Learning 1 Cours + TP + Pre-trained Model + Paper + Rendu Amphi Estaunié + 3B01  
3B07 P. Gori        
02/02/2025 13:30-16:45 Self-Supervised Learning 2 Cours + TP + Pre-trained Model + Paper + Rendu Amphi Dieng + 1A201  
1A207 P. Gori        
09/02/2025 13:30-16:45 Transformers 1 Cours + TP + Rendu Amphi Dieng + 5B01 5B07 L. Le Folgoc
23/02/2025 13:30-16:45 Transformers 2 Cours + TP + Rendu Amphi Dieng + 5B01 5B07 L. Le Folgoc
02/03/2025 13:30-16:45 Variation AutoEncoders (VAE) and Disentanglement Cours + TP1 + TP2 + Rendu Amphi Dieng + 5B01 5B07 L. Le Folgoc
23/03/2025 13:30-16:45 Interpretability and Explainability Cours + TP + Rendu Amphi Dieng + 5B01 5B07 P. Gori
30/03/2025 13:30-16:45 Written Exam   Amphi Thévenin