6 papers
Does the Same Token Mean the Same State? MoE Routing as Signal for Reasoning Control
Kang Chen, Minshen Yu, Junjie Nian +3
In sparse Mixture-of-Experts language models, does the same token id imply the same router state and the same experts producing it? Holding the emitted token id fixed at repeated a…
TraceGraph: Shared Decision Landscapes for Diagnosing and Improving Agent Trajectories
Junjie Nian, Kang Chen, Ge Zhang +2
Agent benchmarks increasingly record rich interaction trajectories, yet evaluation often reduces each rollout to a pass rate or reward score. We introduce TraceGraph, a graph-based…
SliceGraph: Mapping Process Isomers in Multi-Run Chain-of-Thought Reasoning
Kang Chen, Junjie Nian, Yixin Cao +1
Multi-run chain-of-thought reasoning is usually collapsed to final-answer aggregates, which discard howsampled trajectories share, split, and rejoin through intermediate computatio…
NEX: Neuron Explore-Exploit Scoring for Label-Free Chain-of-Thought Selection and Model Ranking
Kang Chen, Zhuoka Feng, Sihan Zhao +5
Large language models increasingly spend inference compute sampling multiple chain-of-thought traces or searching over merged checkpoints. This shifts the bottleneck from generatio…
Thinking Traps in Long Chain-of-Thought: A Measurable Study and Trap-Aware Adaptive Restart
Kang Chen, Fan Yu, Junjie Nian +6
Scaling test-time compute via Long Chain-of-Thought (Long-CoT) significantly enhances reasoning capabilities, yet extended generation does not guarantee correctness: after an early…
ARM: Role-Conditioned Neuron Transplantation for Training-Free Generalist LLM Agent Merging
Zhuoka Feng, Kang Chen, Sihan Zhao +7
Interactive large language model agents have advanced rapidly, but most remain specialized to a single environment and fail to adapt robustly to other environments. Model merging o…