Showing 2026Show all
2 papers · 1 filter
cs.LG2026
MoRE: Scaling mixture of experts with hardware-aware low-rank routing
Honam Wong, Surbhi Goel, Enric Boix-Adserà
Mixture-of-Experts (MoE) layers are central to frontier language models, and recent architectures push toward more and smaller experts. In this regime, the standard linear router b…
cs.LG2026
Is Code Better Than Language for Algorithmic Reasoning
Terry Tong, Yu Feng, Surbhi Goel +1
For tool-augmented language models, comparing natural-language reasoning with code-execution pipelines is difficult because the comparison changes both the intermediate representat…