Bayesian Optimization for Enhanced Language Models: Optimizing Acquisition Functions

Zishuo Bao, Yibo Liu, Changyutao Qiu

With the rise of different language model architecture, fine-tuning is becoming even more important for down stream tasks Model gets messy, finding proper hyperparameters for fine-…