777 citations · 10.3k across the 202 of their papers we have counts for
18 papers · 1 filter
Hardware Beyond Backpropagation: a Photonic Co-Processor for Direct Feedback Alignment
Julien Launay, Iacopo Poli, Kilian Müller +5
The scaling hypothesis motivates the expansion of models past trillions of parameters as a path towards better performance. Recent significant developments, such as GPT-3, have bee…
Construction of optimal spectral methods in phase retrieval
Antoine Maillard, Florent Krzakala, Yue M. Lu +1
We consider the phase retrieval problem, in which the observer wishes to recover a -dimensional real or complex signal from the (possibly noisy) observation o…
Epidemic mitigation by statistical inference from contact tracing data
Antoine Baker, Indaco Biazzo, Alfredo Braunstein +10
Contact-tracing is an essential tool in order to mitigate the impact of pandemic such as the COVID-19. In order to achieve efficient and scalable contact-tracing in real time, digi…
Complex Dynamics in Simple Neural Networks: Understanding Gradient Flow in Phase Retrieval
Stefano Sarao Mannelli, Giulio Biroli, Chiara Cammarota +3
Despite the widespread use of gradient-based algorithms for optimizing high-dimensional non-convex functions, understanding their ability of finding good minima instead of being tr…
Light-in-the-loop: using a photonics co-processor for scalable training of neural networks
Julien Launay, Iacopo Poli, Kilian Müller +4
As neural networks grow larger and more complex and data-hungry, training costs are skyrocketing. Especially when lifelong learning is necessary, such as in recommender systems or…
The Gaussian equivalence of generative models for learning with shallow neural networks
Sebastian Goldt, Bruno Loureiro, Galen Reeves +3
Understanding the impact of data structure on the computational tractability of learning is a key challenge for the theory of neural networks. Many theoretical works do not explici…