General information
Organisation
The French Alternative Energies and Atomic Energy Commission (CEA) is a key player in research, development and innovation in four main areas :
• defence and security,
• nuclear energy (fission and fusion),
• technological research for industry,
• fundamental research in the physical sciences and life sciences.
Drawing on its widely acknowledged expertise, and thanks to its 16000 technicians, engineers, researchers and staff, the CEA actively participates in collaborative projects with a large number of academic and industrial partners.
The CEA is established in ten centers spread throughout France
Reference
SL-DRT-24-0703
Direction
DRT
Thesis topic details
Category
Technological challenges
Thesis topics
Multimodal continual learning under constraints
Contract
Thèse
Job description
Standard deep learning methods are designed to use static data. This induces a significant practical limitation when they are deployed in dynamic environments and are confronted with unknown data. Continuous learning provides a solution to this problem, especially with the use of large, pre-trained models. However, deploying such models in stand-alone mode is currently impossible in many frugal applications that impose heavy computational and/or memory constraints. Furthermore, most current methods are developed for a single modality (text or visual), whereas the data captured is often multimodal.
This thesis proposes to address several objectives that enable the practical deployment of agents capable of updating their representations under constraints. This deployment involves the following objectives:(1) the collection of domain-oriented corpora and their augmentation based on generative multimodal models, (2) the compression of foundation models to adapt them to the domain and make them usable under computational and/or memory constraints, (3) the proposal of efficient continuous learning methods to manage new multimodal data, and (4) the management of realistic data flows to take into account the specificities of different application contexts.
University / doctoral school
Sciences et Technologies de l’Information et de la Communication (STIC)
Paris-Saclay
Thesis topic location
Site
Saclay
Requester
Position start date
01/10/2024
Person to be contacted by the applicant
AUDIGIER Romaric romaric.audigier@cea.fr
CEA
DRT/DIASI//LVIC/SAC
CEA SACLAY
DIASI/LVIC
Bat. 861 - PC 173
91191 Gif-sur-Yvette
01 69 08 01 06
Tutor / Responsible thesis director
POPESCU Adrian adrian.popescu@cea.fr
CEA
DRT/DIASI//LASTI
CEA SACLAY - NANO INNOV
BAT. 861
Point courier 173
91191 GIF SUR YVETTE
0169080154
En savoir plus
https://kalisteo.cea.fr/index.php/