2 papers
stat.ML2025
High-Dimensional Importance-Weighted Information Criteria: Theory and Optimality
Yong-Syun Cao, Shinpei Imori, Ching-Kang Ing
Imori and Ing (2025) proposed the importance-weighted orthogonal greedy algorithm (IWOGA) for model selection in high-dimensional misspecified regression models under covariate shi…
cs.CL2025
QuaDMix: Quality-Diversity Balanced Data Selection for Efficient LLM Pretraining
Fengze Liu, Weidong Zhou, Binbin Liu +8
Quality and diversity are two critical metrics for the training data of large language models (LLMs), positively impacting performance. Existing studies often optimize these metric…