13 papers
Fetch-then-Explore: Decoupling Selection from Extraction over a Persistent Workspace for Search Agents
Qi Liu, Yiqun Chen, Zidan Chen +6
Search agents now answer questions that take dozens of searches to settle, yet how such an agent reads a page has drawn far less attention than how it finds one. Nearly all of them…
Deep Research as Rubric for Reinforcement Learning
Wangyi Mei, Zhouhong Gu, Zhenhan Bai +9
Open-ended reasoning and long-form generation tasks lack reliable automatic verification signals for reward-based policy optimization. Rubrics offer a promising alternative, but ex…
Tournament-GRPO: Group-Wise Tournament Rewards for Reinforcement Learning in Open-Ended Long-Form Generation
Zixuan Yang, Yiqun Chen, Wei Yang +7
Reinforcement learning in open-ended long-form generation is challenging because reliable reference answers and automatic metrics are often unavailable. Existing rubric-based metho…
UnityMAS-O: A General RL Optimization Framework for LLM-Based Multi-Agent Systems
Yiqun Chen, Wei Yang, Erhan Zhang +14
LLM-based multi-agent systems decompose complex tasks into interacting roles, but most remain manually orchestrated by prompts, tools, and control rules, while agents are rarely op…
OASES: Outcome-Aligned Search-Evaluation Co-Training for Agentic Search
Erhan Zhang, Yiqun Chen, Zechun Niu +6
Agentic search enables language models to solve knowledge-intensive tasks by adaptively acquiring external evidence over multiple steps. Reinforcement learning with verifiable rewa…
Knowledge-Graph Paths as Intermediate Supervision for Self-Evolving Search Agents
Huyu Wu, Jun Liu, Xiaochi Wei +3
Self-evolving search agents reduce reliance on human-written training questions by generating and solving their own search tasks. We build on Search Self-Play (SSP), a representati…