1 citations · 1 across the 3 of their papers we have counts for
9 papers
Learning from samples: inverse problems over measures
Francisco Andrade, Gabriel Peyré, Clarice Poon
We study inverse problems where an unknown potential is observed only through samples from the measure it induces by a convex variational principle. Such problems arise in learning…
A Unified Perspective on the Dynamics of Deep Transformers
Valérie Castin, Pierre Ablin, José Antonio Carrillo +1
Transformers, which are state-of-the-art in most machine learning tasks, represent the data as sequences of vectors called tokens. This representation is then exploited by the atte…
Optimal Transport for Machine Learners
Gabriel Peyré, Gabriel Peyré
Modern machine learning repeatedly manipulates probability measures: empirical datasets, generated samples, latent distributions, class-conditional laws, particle systems, weights…
From Score Matching to Diffusion: A Fine-Grained Error Analysis in the Gaussian Setting
Samuel Hurault, Matthieu Terris, Thomas Moreau +1
Sampling from an unknown distribution, accessible only through discrete samples, is a fundamental problem at the core of generative AI. The current state-of-the-art methods follow…
Ultra-fast feature learning for the training of two-layer neural networks in the two-timescale regime
Raphaël Barboni, Gabriel Peyré, François-Xavier Vialard
We study the convergence of gradient methods for the training of mean-field single-hidden-layer neural networks with square loss. For this high-dimensional and non-convex optimizat…
Understanding the training of infinitely deep and wide ResNets with Conditional Optimal Transport
Raphaël Barboni, Gabriel Peyré, François-Xavier Vialard
We study the convergence of gradient flow for the training of deep neural networks. If Residual Neural Networks are a popular example of very deep architectures, their training con…