Data and Evaluation Closed-Loop for Model Capability Enhancement

Zhixuan Li, Jiangan Yuan, Han Xu

Model capability is the central variable in LLM pre-training, yet is never observed directly: data shapes it prospectively, while evaluation reveals it only retrospectively, compre…