82 citations · 99 across the 3 of their papers we have counts for
3 papers
A Random Matrix Theory of Masked Self-Supervised Regression
Arie Wortsman Zurich, Federica Gerace, Bruno Loureiro +1
In the era of transformer models, masked self-supervised learning (SSL) has become a foundational training paradigm. A defining feature of masked SSL is that training aggregates pr…
Gaussian Universality of Perceptrons with Random Labels
Federica Gerace, Florent Krzakala, Bruno Loureiro +2
While classical in many theoretical settings - and in particular in statistical physics-inspired works - the assumption of Gaussian i.i.d. input data is often perceived as a strong…
Generalisation error in learning with random features and the hidden manifold model
Federica Gerace, Bruno Loureiro, Florent Krzakala +2
We study generalised linear regression and classification for a synthetically generated dataset encompassing different problems of interest, such as learning with random features,…