On Task Vectors and Gradients

Luca Zhou, Daniele Solombrino, Donato Crisostomi +4

Task arithmetic has emerged as a simple yet powerful technique for model merging, enabling the combination of multiple finetuned models into one. Despite its empirical success, a c…