123 citations · 163 across the 9 of their papers we have counts for
1 paper · 1 filter
Simin Fan, Alireza Abdollahpoorrostam, Martin Jaggi
Online data selection has demonstrated substantial efficiency gains for LLM pretraining by training on the most valuable candidates within each batch. Since a candidate's value is…