MoEless: Efficient MoE LLM Serving with Serverless Experts

Hanfei Yu, Bei Ouyang, Shwai He +2

Large Language Models (LLMs) increasingly adopt Mixture-of-Experts (MoE) architectures to scale efficiently under stringent resource constraints. However, MoE's sparse activation c…