36 citations · 39 across the 2 of their papers we have counts for
2 papers
cs.DC2023★ 36 cited
Oobleck: Resilient Distributed Training of Large Models Using Pipeline Templates
Insu Jang, Zhenning Yang, Zhen Zhang +2
Oobleck enables resilient distributed training of large DNN models with guaranteed fault tolerance. It takes a planning-execution co-design approach, where it first generates a set…
cs.LG2023★ 3 cited
Chasing Low-Carbon Electricity for Practical and Sustainable DNN Training
Zhenning Yang, Luoxi Meng, Jae-Won Chung +1
Deep learning has experienced significant growth in recent years, resulting in increased energy consumption and carbon emission from the use of GPUs for training deep neural networ…