Can Bayesian Optimization Efficiently Find a Strong Single Expert in Neural Thickets?

Nigel Bastian Cendra, Abdelhamid Ezzerg, Fernando Julio Cendra +2

Gradient-free post-training has emerged as a compelling alternative to gradient-based optimization for large language models (LLMs), but existing approaches remain costly. We ask w…