Model Fusion through Bayesian Optimization in Language Model Fine-Tuning

Chaeyun Jang, Hyungi Lee, Jungtaek Kim +1

Fine-tuning pre-trained models for downstream tasks is a widely adopted technique known for its adaptability and reliability across various domains. Despite its conceptual simplici…