1 paper · 1 filter
Chirag Garg, Eelaaf Zahid, Farhan Ahmed +3
The dominant approach to building domain-specific pretraining corpora is to filter large web archives such as CommonCrawl. This works well for popular domains but breaks down for s…