4 papers
Consolidating RLVR Capabilities Across Domains: A Deep Dive into Fusion Paradigms
Siye Wu, Kai Yang, Yuchen Cai +8
Reinforcement learning with verifiable rewards (RLVR) improves specific capabilities of large language models, but covering multiple capabilities often involves training separate d…
GCPO: Diagnosing and Constraining Subspace Geometry in Rollout RL for LLMs
Kai Yang, Jingwei Xu, Wanyu Wang +4
On-policy rollout methods such as GRPO are central to post-training of large language models, yet they frequently suffer from training instabilities, cross-task capability degradat…
Exploration by Random Distribution Distillation
Zhirui Fang, Kai Yang, Jian Tao +4
Exploration remains a critical challenge in online reinforcement learning, as an agent must effectively explore unknown environments to achieve high returns. Currently, the main ex…
Novelty-Guided Data Reuse for Efficient and Diversified Multi-Agent Reinforcement Learning
Yangkun Chen, Kai Yang, Jian Tao +1
Recently, deep Multi-Agent Reinforcement Learning (MARL) has demonstrated its potential to tackle complex cooperative tasks, pushing the boundaries of AI in collaborative environme…