activity
20232026
most citedMapping of attention mechanisms to a generalized Potts model

31 citations · 31 across the 4 of their papers we have counts for

collaborators
Showing 2024Show all

1 paper · 1 filter

cs.CL2024

A distributional simplicity bias in the learning dynamics of transformers

Riccardo Rende, Federica Gerace, Alessandro Laio +1

The remarkable capability of over-parameterised neural networks to generalise effectively has been explained by invoking a ``simplicity bias'': neural networks prevent overfitting…