57 citations · 72 across the 4 of their papers we have counts for
6 papers · 1 filter
Attacks on Online Learners: a Teacher-Student Analysis
Riccardo Giuseppe Margiotta, Sebastian Goldt, Guido Sanguinetti
Machine learning models are famously vulnerable to adversarial attacks: small ad-hoc perturbations of the data that can catastrophically alter the model predictions. While a large…
Learning curves of generic features maps for realistic datasets with a teacher-student model
Bruno Loureiro, Cédric Gerbelot, Hugo Cui +4
Teacher-student models provide a framework in which the typical-case performance of high-dimensional supervised learning can be described in closed form. The assumptions of Gaussia…
The Gaussian equivalence of generative models for learning with shallow neural networks
Sebastian Goldt, Bruno Loureiro, Galen Reeves +3
Understanding the impact of data structure on the computational tractability of learning is a key challenge for the theory of neural networks. Many theoretical works do not explici…
Modelling the influence of data structure on learning in neural networks: the hidden manifold model
Sebastian Goldt, Marc Mézard, Florent Krzakala +1
Understanding the reasons for the success of deep neural networks trained using stochastic gradient-based methods is a key open problem for the nascent theory of deep learning. The…
Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup
Sebastian Goldt, Madhu S. Advani, Andrew M. Saxe +2
Deep neural networks achieve stellar generalisation even when they have enough parameters to easily fit all their training data. We study this phenomenon by analysing the dynamics…
Generalisation dynamics of online learning in over-parameterised neural networks
Sebastian Goldt, Madhu S. Advani, Andrew M. Saxe +2
Deep neural networks achieve stellar generalisation on a variety of problems, despite often being large enough to easily fit all their training data. Here we study the generalisati…