LatentLoop: Scaling Looped MoE Models with Asymmetric Compute Allocation

Zefeng He, Yunkai Chai, Xiaoyang Chen +5

Looped Mixture-of-Experts (MoE) models combine parameter reuse with sparse computation to improve performance under matched budgets. Prior work demonstrates that different loop vis…