Model-Aware Data Selection from In-and-Out Information Interplay

Yifan Wang, Xiaomin Li, Yuexing Hao +7

LLMs are effective representations that assimilate vast amounts of knowledge during pretraining, but post-training is necessary for models to reliably access this knowledge and "kn…