411 citations · 756 across the 34 of their papers we have counts for
1 paper · 2 filters
Seng Pei Liew, Takuya Kato
Reusing pretrained base models for further pretraining, such as continual pretraining or model growth, is promising at reducing the cost of training language models from scratch. H…