BOSE: A Systematic Evaluation Method Optimized for Base Models

Hongzhi Luan, Changxin Tian, Zhaoxin Huan +4

This paper poses two critical issues in evaluating base models (without post-training): (1) Unstable evaluation during training: in the early stages of pre-training, the models lac…