activity
20222026
most citedMoBiLE: Efficient Mixture-of-Experts Inference on Consumer GPU with Mixture of Big Little Experts

1 citations · 1 across the 7 of their papers we have counts for

collaborators
Showing 2024Show all

1 paper · 1 filter

cs.AR2024

SOFA: A Compute-Memory Optimized Sparsity Accelerator via Cross-Stage Coordinated Tiling

Huizheng Wang, Jiahao Fang, Xinru Tang +9

Benefiting from the self-attention mechanism, Transformer models have attained impressive contextual comprehension capabilities for lengthy texts. The requirements of high-throughp…