152 citations · 287 across the 11 of their papers we have counts for
1 paper · 2 filters
Wuyang Chen, Yanqi Zhou, Nan Du +4
Pretraining on a large-scale corpus has become a standard method to build general language models (LMs). Adapting a model to new data distributions targeting different downstream t…