4 papers
From Concentration to Differentiation and Back: Routing Effective Rank in MoE Reasoning Cohorts
Kang Chen, Sihan Zhao, Yixin Cao +1
Test-time scaling produces cohorts of reasoning rollouts, yet there is no standard label-free account of how their internal computation reorganizes as inference unfolds. We introdu…
Beyond the Trace: Coupling an Interpretable Reasoning-State Readout to Native MoE Routing
Kang Chen, Sihan Zhao, Yixin Cao +1
What a reasoning model writes is only a partial record of the process that produces it. We introduce a two-level internal readout for mixture-of-experts reasoning. We first distill…
NEX: Neuron Explore-Exploit Scoring for Label-Free Chain-of-Thought Selection and Model Ranking
Kang Chen, Zhuoka Feng, Sihan Zhao +5
Large language models increasingly spend inference compute sampling multiple chain-of-thought traces or searching over merged checkpoints. This shifts the bottleneck from generatio…
ARM: Role-Conditioned Neuron Transplantation for Training-Free Generalist LLM Agent Merging
Zhuoka Feng, Kang Chen, Sihan Zhao +7
Interactive large language model agents have advanced rapidly, but most remain specialized to a single environment and fail to adapt robustly to other environments. Model merging o…