Conférence
Notice
Lieu de réalisation
École Normale Supérieure, Paris.
Langue :
Anglais
Crédits
Claire Boyer (Production), Djalil Chafaï (Production), Joseph Lehec (Production), Lenka Zdeborová (Intervention)
Conditions d'utilisation
Droit commun de la propriété intellectuelle
DOI : 10.60527/7v1m-jk18
Citer cette ressource :
Lenka Zdeborová. CEREMADE. (2019, 3 juillet). Zdeborová - Loss landscape and behaviour of algorithms in the spiked matrix-tensor model. [Vidéo]. Canal-U. https://doi.org/10.60527/7v1m-jk18. (Consultée le 20 septembre 2024)

Zdeborová - Loss landscape and behaviour of algorithms in the spiked matrix-tensor model

Réalisation : 3 juillet 2019 - Mise en ligne : 3 novembre 2019
  • document 1 document 2 document 3
  • niveau 1 niveau 2 niveau 3
Descriptif

A key question of current interest is: How are properties of optimization and sampling algorithms influenced by the properties of the loss function in noisy high-dimensional non-convex settings? Answering this question for deep neural networks is a landmark goal of many ongoing works. In this talk I will answer this question in unprecedented detail for the spiked matrix-tensor model. Information theoretic limits, and Kac-Rice analysis of the loss landscapes, will be compared to the analytically studied performance of message passing algorithms, of the Langevin dynamics and of the gradient flow. Several rather non-intuitive results will be unveiled and explained.

Intervention