FORGE: Procedural Weight Generation for Sparse MoE Inference

Chanyoung Moon, Travis Pence, Daisuke Yamada +4

We introduce FORGE (Fast On-chip Rotor Generation for Experts), a procedural weight generation system for Sparse Mixture-of-Experts (MoE) inference. Rather than storing and loading…