3 papers
cs.AI2026
Polysemantic Experts, Monosemantic Paths: Routing as Control in MoEs
Charles Ye, Bo Yuan, Lee Sharkey
An LLM's residual stream is both state and instruction: it encodes the current context and determines the next transformation. We introduce a parameter-free decomposition for Mixtu…
cs.CL2026
Emergent Search and Backtracking in Latent Reasoning Models
Jasmine Cui, Charles Ye
What happens when a language model thinks without words? Standard reasoning LLMs verbalize intermediate steps as chain-of-thought; latent reasoning transformers (LRTs) instead perf…
cs.LG2026
Efficient Representations are Controllable Representations
Charles Ye, Jasmine Cui
What is the most brute-force way to install interpretable, controllable features into a model's activations? Controlling how LLMs internally represent concepts typically requires s…