4 papers · 1 filter
UniOPSD: Unifying Outcome and Hindsight Feedback for Agentic Reinforcement Learning
Zenghuang Fu, Zhaoyang Li, Qiuyuan Ai +8
Reinforcement learning has become an effective approach to training language model agents, but sparse and delayed outcome rewards provide limited guidance for credit assignment acr…
SIPO: Selective-Inference Policy Optimization for Tree-Structured Agentic RL
Zenghuang Fu, Ningqi Chen, Mingda Jia +10
Tree-structured reinforcement learning trains search agents by comparing alternative continuations and propagating terminal rewards to intermediate decisions. Adaptive expansion, h…
CoEvoKG: Co-Evolving Knowledge Graphs with Self-Evolving Search Agents
Zhaoyang Li, Zenghuang Fu, Qiuyuan Ai +6
Large language models can improve with reinforcement learning for search agents, yet existing self play agents repeatedly generate tasks while discarding the knowledge gained durin…
Self-Play Meets Skill Evolution: Self-Evolving Search Agents that Pose, Solve, and Remember
Zenghuang Fu, Zhaoyang Li, Qiuyuan Ai +6
Self-play agents can generate training problems without questions from target benchmarks, but their curricula lack persistent state: failures affect gradients yet do not explicitly…