Pause
Read
CEA vacancy search engine

Efficient Multimodal Vision Transformers for Embedded System


Thesis topic details

General information

Organisation

The French Alternative Energies and Atomic Energy Commission (CEA) is a key player in research, development and innovation in four main areas :
• defence and security,
• nuclear energy (fission and fusion),
• technological research for industry,
• fundamental research in the physical sciences and life sciences.

Drawing on its widely acknowledged expertise, and thanks to its 16000 technicians, engineers, researchers and staff, the CEA actively participates in collaborative projects with a large number of academic and industrial partners.

The CEA is established in ten centers spread throughout France
  

Reference

SL-DRT-25-0566  

Direction

DRT

Thesis topic details

Category

Technological challenges

Thesis topics

Efficient Multimodal Vision Transformers for Embedded System

Contract

Thèse

Job description

The proposed thesis focuses on the optimization of multimodal vision transformers (ViT) for panoptic object segmentation, exploring two main directions. The first is to develop a versatile fusion pipeline to integrate multimodal data (RGB, IR, depth, events, point clouds) by leveraging inter-modal alignment relationships. The second is to investigate an approach combining pruning and mixed-precision quantization. The overall goal is to design lightweight multimodal ViT models, tailored to the constraints of embedded systems, while optimizing their performance and reducing computational complexity.

University / doctoral school

Sciences et Technologies de l’Information et de la Communication (STIC)
Evry Val d’Essonne

Thesis topic location

Site

Saclay

Requester

Position start date

01/10/2025

Person to be contacted by the applicant

POREBA Martyna martyna.poreba@cea.fr
CEA
DRT/DSCIN/DSCIN/LIAE
CEA LIST, Site Nano-INNOV
2 Boulevard Thomas Gobert
91120 PALAISEAU

+33 (0)1.69.08.00.42

Tutor / Responsible thesis director

BOUCHAFA-BRUNEAU Samia samia.bouchafabruneau@univ-evry.fr
Univ Evry/Université Paris-Saclay
Laboratoire IBISC - Univ Evry/Université Paris-Saclay
Laboratoire IBISC - Univ Evry/Université Paris-Saclay
40 rue du Pelvoux, 91020 Evry - France

+33 (0)169470648

En savoir plus