15 citations · 16 across the 2 of their papers we have counts for
2 papers
cs.DC2023★ 15 cited
ZeRO++: Extremely Efficient Collective Communication for Giant Model Training
Guanhua Wang, Heyang Qin, Sam Ade Jacobs +6
Zero Redundancy Optimizer (ZeRO) has been used to train a wide range of large language models on massive GPUs clusters due to its ease of use, efficiency, and good scalability. How…
cs.LG2021★ 1 cited
The Age of Correlated Features in Supervised Learning based Forecasting
Md Kamran Chowdhury Shisher, Heyang Qin, Lei Yang +2
In this paper, we analyze the impact of information freshness on supervised learning based forecasting. In these applications, a neural network is trained to predict a time-varying…