Showing cs.DCShow all
2 papers · 1 filter
cs.DC2026
CWind: A Cross-site Router for Large Language Model Inference Serving at Renewable Energy Farms
Tella Rajashekhar Reddy, Atharva Deshmukh, Liangcheng Yu +7
AI power demand is growing at an unprecedented rate while power grids are often ailing and struggle to keep up. Grid expansion comes with high capital expenditure and long-distance…
cs.DC2025
BeLLMan: Controlling LLM Congestion
Tella Rajashekhar Reddy, Atharva Deshmukh, Karan Tandon +3
Large language model (LLM) applications are blindfolded to the infrastructure underneath and generate tokens autoregressively, indifferent to the system load, thus risking inferenc…