105 citations · 105 across the 5 of their papers we have counts for
1 paper · 1 filter
Zhengqing Yuan, Hanchi Sun, Lichao Sun +1
We present MegaTrain, a memory-centric system that efficiently trains 100B+ parameter large language models at full precision on a single GPU. Unlike traditional GPU-centric system…