50 citations · 50 across the 1 of their papers we have counts for
1 paper
Bowen Baker, Ilge Akkaya, Peter Zhokhov +6
Pretraining on noisy, internet-scale datasets has been heavily studied as a technique for training models with broad, general capabilities for text, images, and other modalities. H…