1 citations · 1 across the 3 of their papers we have counts for
4 papers
A Dynamical Theory of LoRA in Continual Learning
Théo Marchetta, Filippo Alessandroni, Alessandro Breccia +2
Despite the widespread use of Low-Rank Adaptation (LoRA), little is known about its dynamics in continual learning and the mechanisms by which low-rank updates affect catastrophic…
Variational Bounds for Perceptron Learning from Structured Data
Francesco Camilli, Pierluigi Contucci, Federica Gerace +1
We introduce a variational approach to a finite-temperature continuous-spin perceptron trained on a Gaussian mixture. The model allows for a broad class of concave utilities and lo…
Generalization performance of narrow one-hidden layer networks in the teacher-student setting
Rodrigo Pérez Ortiz, Gibbs Nwemadji, Jean Barbier +4
Understanding the generalization properties of neural networks on simple input-output distributions is key to explaining their performance on real datasets. The classical teacher-s…
Statistical mechanics of transfer learning in fully-connected networks in the proportional limit
Alessandro Ingrosso, Rosalba Pacelli, Pietro Rotondo +1
Transfer learning (TL) is a well-established machine learning technique to boost the generalization performance on a specific (target) task using information gained from a related…