Variational Model Merging for Pareto Front Estimation in Multitask Finetuning

Hugo Monzón Maldonado, Nico Daheim, Thomas Möllenhoff +2

Pareto fronts are useful to find good task-mixing strategies for multitask finetuning, but they are also costly to compute. To reduce costs, recent works have used existing model m…