Reducing Energy Bloat in Large Model Training

Jae-Won Chung, Yile Gu, Insu Jang +3

Training large AI models on numerous GPUs consumes a massive amount of energy, making power delivery one of the largest limiting factors in building and operating datacenters for A…