162 citations · 171 across the 5 of their papers we have counts for
1 paper · 1 filter
Yiqun Yao, Zheng Zhang, Jing Li +1
Accelerating large language model pre-training is a critical issue in present research. In this paper, we focus on speeding up pre-training by progressively growing from a small Tr…