127 citations · 319 across the 41 of their papers we have counts for
3 papers · 2 filters
IrekoGPT: Turning Structured Pruning into Post-Hoc Slimmable LLMs
Pietro Moriello, Pietro Buzzega, Angelo Porrello +1
We introduce IrekoGPT, a post-hoc method for converting pretrained LLMs into slimmable models whose width can be adjusted at inference time. Building on SliceGPT, we retain its pro…
Distilling Linearized Behavior into Non-Linear Fine-Tuning for Effective Task Arithmetic
Thomas Sommariva, Francesca Morandi, Simone Calderara +1
Task vector composition has emerged as a promising paradigm for editing pre-trained models, enabling model merging through addition and unlearning through subtraction. Fine-tuning…
Transporting Task Vectors across Different Architectures without Training
Filippo Rinaldi, Aniello Panariello, Giacomo Salici +2
Adapting large pre-trained models to downstream tasks often produces task-specific parameter updates that are expensive to relearn for every model variant. While recent work has sh…