2 papers
cs.LG2025
From Score Distributions to Balance: Plug-and-Play Mixture-of-Experts Routing
Rana Shahout, Colin Cai, Yilun Du +2
Mixture-of-Experts (MoE) models can scale parameter capacity by routing each token to a subset of experts through a learned gate function. While conditional routing reduces trainin…
cs.PL2024
Tenspiler: A Verified Lifting-Based Compiler for Tensor Operations (Extended Version)
Jie Qiu, Colin Cai, Sahil Bhatia +3
Tensor processing infrastructures such as deep learning frameworks and specialized hardware accelerators have revolutionized how computationally intensive code from domains such as…