1 citations · 1 across the 8 of their papers we have counts for
1 paper · 1 filter
Kang Liu, Wei Peng, Jianchen Hu
Optimizer states occupy massive GPU memory in large-scale model training. However, gradients in different network blocks exhibit distinct behaviors, such as varying directional sta…