1 citations · 2 across the 17 of their papers we have counts for
1 paper · 2 filters
Steven Feng, Shrimai Prabhumoye, Kezhi Kong +4
Pretraining large language models effectively requires strategic data selection, blending and ordering. However, key details about data mixtures especially their scalability to lon…