105 citations · 108 across the 3 of their papers we have counts for
1 paper · 1 filter
Roseval Malaquias Junior, Ramon Pires, Roseli Romero +1
The high compute cost associated with pretraining large language models limits their research. Two strategies have emerged to address this issue: domain specialization and pretrain…