3 citations · 4 across the 21 of their papers we have counts for
8 papers · 1 filter
IrekoGPT: Turning Structured Pruning into Post-Hoc Slimmable LLMs
Pietro Moriello, Pietro Buzzega, Angelo Porrello +1
We introduce IrekoGPT, a post-hoc method for converting pretrained LLMs into slimmable models whose width can be adjusted at inference time. Building on SliceGPT, we retain its pro…
Rethinking Expert Training for Model Merging with Prompt Learning
Christos Georgakilas, Aniello Panariello, Samir El Karrat Moreno +3
Model merging aims to combine multiple domain-specialized experts trained from a shared foundation model into a single multi-task model. Existing approaches largely focus on improv…
Robust Zero-Shot Generalization for Open-Vocabulary Action Recognition via Task Arithmetic
Francesca Morandi, Omayma Moussadek, Federico Venturini +5
Open Vocabulary Action Recognition (OVAR) enables the recognition of novel actions by leveraging vision-language representations, overcoming the limitations of traditional closed-s…
Distilling Linearized Behavior into Non-Linear Fine-Tuning for Effective Task Arithmetic
Thomas Sommariva, Francesca Morandi, Simone Calderara +1
Task vector composition has emerged as a promising paradigm for editing pre-trained models, enabling model merging through addition and unlearning through subtraction. Fine-tuning…
Zero-Shot Synthetic-to-Real Handwritten Text Recognition via Task Analogies
Carlos Garrido-Munoz, Aniello Panariello, Silvia Cascianelli +4
Handwritten Text Recognition (HTR) models trained on synthetic handwriting often struggle to generalize to real text, and existing adaptation methods still require real samples fro…
ABRA: Teleporting Fine-Tuned Knowledge Across Domains for Open-Vocabulary Object Detection
Mattia Bernardi, Chiara Cappellino, Matteo Mosconi +3
Although recent Open-Vocabulary Object Detection architectures, such as Grounding DINO, demonstrate strong zero-shot capabilities, their performance degrades significantly under do…
Dataless Weight Disentanglement in Task Arithmetic via Kronecker-Factored Approximate Curvature
Angelo Porrello, Pietro Buzzega, Felix Dangel +4
Task Arithmetic yields a modular, scalable way to adapt foundation models. Combining multiple task vectors, however, can lead to cross-task interference, causing representation dri…
Transporting Task Vectors across Different Architectures without Training
Filippo Rinaldi, Aniello Panariello, Giacomo Salici +2
Adapting large pre-trained models to downstream tasks often produces task-specific parameter updates that are expensive to relearn for every model variant. While recent work has sh…