4 papers
Vela: User Behavior as Supervision Sparks LLM Intelligence
Yang Xiao, Yusong Sun, Haoyi Wu +17
Large language models are increasingly deployed in applications that act on users' long-term behavior histories, from personal assistants to recommendation and advertising systems.…
CompoWorld: Compositional Environment Scaling for General Agents
Xiao-Wen Yang, Weiyi Xu, Wen Da +9
Automatically generated environments provide a scalable source of interaction data for training general agents. However, existing approaches mainly generate tasks within a single e…
PACT: From Credit Assignment to Critic Alignment
Jiayan Fu, Hang Xu, Yong Zhang +4
Reinforcement learning has become a central component of large language model (LLM) post-training, yet token-level credit lacks a generally accepted mathematical definition, leavin…
PILOT in the Loop: Live Self-Improvement for Long-Horizon Agents
Yang Xiao, Yusong Sun, Haoyi Wu +7
Long-horizon agent runs generate experience that can improve both the current run and future work. Most self-improvement methods process this experience only after execution ends,…