91 citations · 254 across the 20 of their papers we have counts for
4 papers · 1 filter
A distributional simplicity bias in the learning dynamics of transformers
Riccardo Rende, Federica Gerace, Alessandro Laio +1
The remarkable capability of over-parameterised neural networks to generalise effectively has been explained by invoking a ``simplicity bias'': neural networks prevent overfitting…
Policy-guided Monte Carlo on general state spaces: Application to glass-forming mixtures
Leonardo Galliano, Riccardo Rende, Daniele Coslovich
Policy-guided Monte Carlo is an adaptive method to simulate classical interacting systems. It adjusts the proposal distribution of the Metropolis-Hastings algorithm to maximize the…
Are queries and keys always relevant? A case study on Transformer wave functions
Riccardo Rende, Luciano Loris Viteritti
The dot product attention mechanism, originally designed for natural language processing tasks, is a cornerstone of modern Transformers. It adeptly captures semantic relationships…
Fine-tuning Neural Network Quantum States
Riccardo Rende, Sebastian Goldt, Federico Becca +1
Recent progress in the design and optimization of neural-network quantum states (NQSs) has made them an effective method to investigate ground-state properties of quantum many-body…