Training-Free Transformer Merging via Sequential Local Operator Alignment

Akansh Maurya, Ya-Wei Eileen Lin, Stefanie Jegelka +2

Training-free model merging aims to combine multiple fine-tuned models into a single model without further optimization on labeled data. Yet, in transformers, independently merging…