Multi-Layer Scheduling for MoE-Based LLM Reasoning

Yifan Sun, Gholamreza Haffari, Minxian Xu +2

Large Language Models (LLMs) have achieved remarkable success across a wide range of tasks, but serving them efficiently at scale remains a critical challenge due to their substant…