4 papers · 1 filter
Drafting Agents, Not Just Tokens: Speculative Recursive Self-Improvement for Agentic Systems
Xin Xu, Ke Cheng, Hao Wang +11
Improving an agent through successive revisions requires balancing exploration and evaluation under a limited budget. A narrow search can miss useful sequences of edits, while full…
What Should Data Teach? Moving Bottlenecks Across Circuit, Store, and Use
Yixiao Chen, Ke Cheng, Jiangtao Guan +5
What should data teach a language model at a particular point in training? A circuit view reveals three distinct bottlenecks: forming a computation, making its required content ava…
PRISM: Parallel Residual Iterative Sequence Model
Jie Jiang, Ke Cheng, Xin Xu +8
Generative sequence modeling faces a fundamental tension between the expressivity of Transformers and the efficiency of linear sequence models. Existing efficient architectures are…
Breaking the Curse of Repulsion: Remoteness-Aware Control of Negative Off-Policy Updates
Yusen Huo, Changping Wang, Yangru Huang +2
Off-policy policy optimization reuses historical behavior, including negative-advantage samples that suppress known failures. We show that repeated reuse can turn this useful signa…