149 citations · 545 across the 20 of their papers we have counts for
4 papers · 1 filter
A Dynamical Theory of LoRA in Continual Learning
Théo Marchetta, Filippo Alessandroni, Alessandro Breccia +2
Despite the widespread use of Low-Rank Adaptation (LoRA), little is known about its dynamics in continual learning and the mechanisms by which low-rank updates affect catastrophic…
An Analytical Theory of Auxiliary Learning
Federico Milanesio, Alessandro Ingrosso, Matteo Osella
Auxiliary learning is an optimization paradigm in which a neural network's performance on a target task is improved by jointly training it on additional tasks. However, the mechani…
Coarse-Graining Hidden Representations: Unsupervised Neuron Selection via Mapping Entropy
Margherita Mele, Andrea Castagna, Roberto Menichetti +2
Overparameterized neural networks carry far more hidden units than a task nominally requires, raising the question of which neurons are essential and whether that distinction is le…
The dimensionality of the Hopfield model
Cristopher Erazo, Santiago Acevedo, Alessandro Ingrosso
We use the Binary Intrinsic Dimension (BID), a geometrical measure designed for binary data, to analyze the Hopfield model, a paradigmatic spin system from statistical mechanics, m…