Pause
Read
CEA vacancy search engine

Deep Neural Network Uncertainty Estimation on Embedded Targets


Thesis topic details

General information

Organisation

The French Alternative Energies and Atomic Energy Commission (CEA) is a key player in research, development and innovation in four main areas :
• defence and security,
• nuclear energy (fission and fusion),
• technological research for industry,
• fundamental research in the physical sciences and life sciences.

Drawing on its widely acknowledged expertise, and thanks to its 16000 technicians, engineers, researchers and staff, the CEA actively participates in collaborative projects with a large number of academic and industrial partners.

The CEA is established in ten centers spread throughout France
  

Reference

SL-DRT-24-0026  

Direction

DRT

Thesis topic details

Category

Technological challenges

Thesis topics

Deep Neural Network Uncertainty Estimation on Embedded Targets

Contract

Thèse

Job description

Over the last decade, Deep NeuralNetworks (DNNs) have become a popular choice to implement Learning-Enabled Components LECs in automated systems thanks to their effectiveness in processing complex sensory inputs, and their powerful representation learning that surpasses the performance of traditional methods. Despite the remarkable progress in representation learning, DNNs should also represent the confidence in their predictions to deploy them in safety-critical systems. Bayesian Neural Networks (BNNs) offer a principled framework to model and capture uncertainty in LECs. However, exact inference in BNNs is difficult to compute. Thus, we rely on sampling techniques to approximate the true posterior of the weights for computing the posterior predictive distribution (inference). In this regard, relatively simple though computationally and memory expensive sample-based methods have been pro posed for approximate Bayesian inference to quantify uncertainty in DNNs, e.g., Monte-Carlo dropout or Deep Ensembles. Efficient DNN uncertainty estimation in resource-constrained hardware platforms remains an open problem, limiting the adoption within applications from highly automated systems that possess strict computation and memory budgets, tight time constraints, and safety requirements. This thesis aims to develop novel methods and hardware optimizations for efficient and reliable uncertainty estimation in modern DNN architectures deployed in hardware platforms with limited computation resources.

University / doctoral school

Sciences et Technologies de l’Information et de la Communication (STIC)
Paris-Saclay

Thesis topic location

Site

Saclay

Requester

Position start date

01/10/2024

Person to be contacted by the applicant

ARNEZ YAGUALCA Fabio Alejandro fabio.arnez@cea.fr
CEA
DRT/DILS//LSEA

Tutor / Responsible thesis director

MRAIDHA Chokri chokri.mraidha@cea.fr
CEA
DRT/DILS//LSEA
CEA Saclay
DRT/LIST/DILS/LSEA
91191 Gif-sur-Yvette
France
0169084889

En savoir plus


www.list.cea.fr