10 papers · 1 filter
Distilling Linearized Behavior into Non-Linear Fine-Tuning for Effective Task Arithmetic
Thomas Sommariva, Francesca Morandi, Simone Calderara +1
Task vector composition has emerged as a promising paradigm for editing pre-trained models, enabling model merging through addition and unlearning through subtraction. Fine-tuning…
Transporting Task Vectors across Different Architectures without Training
Filippo Rinaldi, Aniello Panariello, Giacomo Salici +2
Adapting large pre-trained models to downstream tasks often produces task-specific parameter updates that are expensive to relearn for every model variant. While recent work has sh…
Rethinking Layer-wise Model Merging through Chain of Merges
Pietro Buzzega, Riccardo Salami, Angelo Porrello +1
Fine-tuning pretrained models has become a standard pathway to achieve state-of-the-art performance across a wide range of domains, leading to a proliferation of task-specific mode…
Gradient-Sign Masking for Task Vector Transport Across Pre-Trained Models
Filippo Rinaldi, Aniello Panariello, Giacomo Salici +4
When a new release of a foundation model is published, practitioners typically need to repeat fine-tuning, even if the same task was already tackled in the previous version. A prom…
Intrinsic Training Signals for Federated Learning Aggregation
Cosimo Fiorini, Matteo Mosconi, Pietro Buzzega +2
Federated Learning (FL) enables collaborative model training across distributed clients while preserving data privacy. While existing approaches for aggregating client-specific cla…
Update Your Transformer to the Latest Release: Re-Basin of Task Vectors
Filippo Rinaldi, Giacomo Capitani, Lorenzo Bonicelli +6
Foundation models serve as the backbone for numerous specialized models developed through fine-tuning. However, when the underlying pretrained model is updated or retrained (e.g.,…