215 citations · 868 across the 14 of their papers we have counts for
1 paper · 1 filter
Bowen Baker, Ilge Akkaya, Peter Zhokhov +6
Pretraining on noisy, internet-scale datasets has been heavily studied as a technique for training models with broad, general capabilities for text, images, and other modalities. H…