Analytical Power-Aware Provisioning for Prefill-Decode Disaggregated AI Inference

Mingyuan Yan, Haiyu Wang, Linxuan Biao +3

Power availability increasingly constrains the operation of AI inference fleets, creating a need for provisioning methods that jointly consider serving capacity and power consumpti…