51 citations · 87 across the 14 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.AR2026
MonoMoE: An Efficient Fused Mega-kernel for Quantized MoE Decoding
Yu Gong, Kailash Budhathoki, Taeho Kim +2
Mixture-of-Experts (MoE) layers increase model capacity without proportionally increasing arithmetic, but their sparse expert computation is difficult to execute efficiently during…
stat.ML2026
When LLMs get significantly worse: A statistical approach to detect model degradations
Jonas Kübler, Kailash Budhathoki, Matthäus Kleindessner +4
Minimizing the inference cost and latency of foundation models has become a crucial area of research. Optimization approaches include theoretically lossless methods and others with…