Area-Efficient In-Memory Computing for Mixture-of-Experts via Multiplexing and Caching

Hanyuan Gao, Xiaoxuan Yang

Mixture-of-Experts (MoE) layers activate a subset of model weights, dubbed experts, to improve model performance. MoE is particularly promising for deployment on process-in-memory…