4 papers
Drafting Agents, Not Just Tokens: Speculative Recursive Self-Improvement for Agentic Systems
Xin Xu, Ke Cheng, Hao Wang +11
Improving an agent through successive revisions requires balancing exploration and evaluation under a limited budget. A narrow search can miss useful sequences of edits, while full…
What Should Data Teach? Moving Bottlenecks Across Circuit, Store, and Use
Yixiao Chen, Ke Cheng, Jiangtao Guan +5
What should data teach a language model at a particular point in training? A circuit view reveals three distinct bottlenecks: forming a computation, making its required content ava…
Recurrent Preference Memory for Efficient Long-Sequence Generative Recommendation
Yixiao Chen, Yuan Wang, Yue Liu +9
Generative recommendation (GenRec) models typically model user behavior via full attention, but scaling to lifelong sequences is hindered by prohibitive computational costs and noi…
PRISM: Parallel Residual Iterative Sequence Model
Jie Jiang, Ke Cheng, Xin Xu +8
Generative sequence modeling faces a fundamental tension between the expressivity of Transformers and the efficiency of linear sequence models. Existing efficient architectures are…