1 citations · 2 across the 17 of their papers we have counts for
1 paper · 1 filter
Steven Feng, Shrimai Prabhumoye, Kezhi Kong +4
Pretraining large language models effectively requires strategic data selection, blending and ordering. However, key details about data mixtures especially their scalability to lon…