15 citations · 17 across the 8 of their papers we have counts for
Showing cs.ARShow all
2 papers · 1 filter
cs.AR2026
MonoMoE: An Efficient Fused Mega-kernel for Quantized MoE Decoding
Yu Gong, Kailash Budhathoki, Taeho Kim +2
Mixture-of-Experts (MoE) layers increase model capacity without proportionally increasing arithmetic, but their sparse expert computation is difficult to execute efficiently during…
cs.AR2026
Fast Cross-Operator Optimization of Attention Dataflow
Haodong Chang, Hailiang Hu, Zhenrui Wang +5
Attention is a fundamental computational kernel that accounts for the majority of the workload in transformer and LLM computing. Optimizing dataflow is crucial for enhancing both p…