ButterflyViT: 354$\times$ Expert Compression for Edge Vision Transformers

Aryan Karmore

Deploying sparse Mixture of Experts(MoE) Vision Transformers remains a challenge due to linear expert memory scaling. Linear memory scaling stores $N$ independent expert weight mat…