EAT: Expert Account Tracker for Efficient MoE Inference

Yuexian Li, Yifei Yang, Zouying Cao +1

Mixture-of-Experts (MoE) models have emerged as a revolutionary method to scale Transformer models. However, traditional MoE architecture still suffers from inefficiency since a la…