UniGeM: Unifying Data Mixing and Selection via Geometric Exploration and Mining

Changhao Wang, Yunfei Yu, Xinhao Yao +5

The scaling of Large Language Models (LLMs) is increasingly limited by data quality. Most methods handle data mixing and sample selection separately, which can break the structure…