activity
20222026
most citedMoBiLE: Efficient Mixture-of-Experts Inference on Consumer GPU with Mixture of Big Little Experts

1 citations · 1 across the 7 of their papers we have counts for

collaborators
Showing 2026Show all

1 paper · 1 filter

cs.AR2026

PADE: A Predictor-Free Sparse Attention Accelerator via Unified Execution and Stage Fusion

Huizheng Wang, Hongbin Wang, Zichuan Wang +5

Attention-based models have revolutionized AI, but the quadratic cost of self-attention incurs severe computational and memory overhead. Sparse attention methods alleviate this by…