From the 2 of 6 linked papers with an AI index.
6 papers
Group-Reflective Self-Distillation for Agentic Reinforcement Learning
Binbin Zheng, Zijun Xie, Guanqun Zhao +4
The paper introduces Group-Reflective Self-Distillation (GRSD), a method that uses a policy's own verified rollouts to generate privileged guidance for better credit assignment in…
Deconstructing Off-Policy Ratios: Entropy-Scaled Trust Regions for Asynchronous Reinforcement Learning
Guanqun Zhao, Zijun Xie, Binbin Zheng +5
Asynchronous reinforcement learning (RL) accelerates large language model (LLM) post-training by overlapping rollout generation with policy optimization, but the resulting stale, o…
ECHO: Prune To Act, Trace To Learn With Selective Turn Memory In Agentic RL
Zijun Xie, Binbin Zheng, Enlei Gong +7
The paper introduces ECHO, a framework that compresses each interaction turn of a language agent into indexed memory records and selectively reconstructs context for decision makin…
ACPO: Asymmetric Credit Policy Optimization via Mode-Local Entropy Surrogate
Zijun Xie, Yuyang You, Yongzhi Li +8
Outcome-supervised reinforcement learning scales to verifiable reasoning tasks, but trajectory-level rewards assign the same outcome signal to all sampled tokens, overlooking their…
SCOPE: Signal-Calibrated On-Policy Distillation Enhancement with Dual-Path Adaptive Weighting
Binbin Zheng, Xing Ma, Yiheng Liang +6
On-policy reinforcement learning has become the dominant paradigm for reasoning alignment in large language models, yet its sparse, outcome-level rewards make token-level credit as…
From to : Taming Divergence in Soft Clipping via Bilateral Decoupled Decay of Probability Gradient Weight
Xiaoliang Fu, Jiaye Lin, Yangyi Fang +6
Reinforcement Learning with Verifiable Rewards (RLVR) has catalyzed a leap in Large Language Model (LLM) reasoning, yet its optimization dynamics remain fragile. Standard algorithm…