2 citations · 3 across the 3 of their papers we have counts for
1 paper · 1 filter
Kashun Shum, Yuzhen Huang, Hongjian Zou +5
Language model pretraining involves training on extensive corpora, where data quality plays a pivotal role. In this work, we aim to directly estimate the contribution of data durin…