Measured Joules, Learned Routes: Learning to Route for Energy-Efficient LLM Serving

Muhammad Abdur Rab Siddiqui, Daniela Rojas, Chen Yang +3

Large language models (LLMs) and agentic AI systems are creating rapidly growing inference energy demands as model sizes grow and reasoning trajectories extend. While in practice,…