Multi-Objective Bayesian Optimization for Model Merging

Utkarsh Agarwal, Vamshi Bonagiri, Raul Astudillo +1

Model merging combines trained models directly in weight space, offering a compute-efficient alternative to additional fine-tuning. Selecting merge parameters is nevertheless diffi…