activity
20242026
most citedThe N+ Implementation Details of RLHF with PPO: A Case Study on TL;DR Summarization

2 citations · 4 across the 26 of their papers we have counts for

collaborators
Showing 2026Show all

8 papers · 1 filter

cs.LG2026

Scaling Laws for Collapse in Asynchronous GRPO

Jingwei Song, Haofeng Xu, Jie Xiao +10

Asynchronous reinforcement learning improves the throughput of large language model post-training by decoupling rollout generation from policy optimization, but introduces a mismat…

cs.LG2026

The Mirage of Optimizing Training Policies: Monotonic Inference Policies as the Real Objective for LLM Reinforcement Learning

Jing Liang, Hongyao Tang, Yi Ma +9

Reinforcement learning (RL) has gained growing attention in large language model (LLM) post-training, yet RL training remains fragile and can suffer from instability or collapse. O…

cs.LG2026

How Does Reasoning Flow? Tracing Attention-Induced Information Flow for Targeted RL in LLMs

Zhichen Dong, Yang Li, Yuhan Sun +9

Token-level credit assignment remains a key obstacle for reinforcement learning (RL) in large language models (LLMs), where RL recipes typically treat all tokens equally, failing t…

cs.DC2026

ROSE: Rollout On Serving GPUs via Cooperative Elasticity for Agentic RL

Wei Gao, Yuheng Zhao, Dilxat Muhtar +13

Agentic reinforcement learning (RL) is reshaping LLM post-training, but end-to-end training time is dominated by compute-intensive, multi-turn rollouts whose resource demand varies…

cs.LG2026

Complementary RL: Towards Efficient Experience-Driven Agent Learning

Dilxat Muhtar, Jiashun Liu, Wei Gao +8

Reinforcement Learning (RL) has emerged as a powerful paradigm for training LLM-based agents, yet remains limited by low sample efficiency, stemming not only from sparse outcome fe…

cs.CL2026

CE-RM: A Pointwise Generative Reward Model Optimized via Two-Stage Rollout and Unified Criteria

Xinyu Hu, Yancheng He, Weixun Wang +6

Automatic evaluation is crucial yet challenging for open-ended natural language generation, especially when rule-based metrics are infeasible. Compared with traditional methods, th…

cs.AI2026

ShopSimulator: Evaluating and Exploring RL-Driven LLM Agent for Shopping Assistants

Pei Wang, Yanan Wu, Xiaoshuai Song +13

Large language model (LLM)-based agents are increasingly deployed in e-commerce shopping. To perform thorough, user-tailored product searches, agents should interpret personal pref…

cs.LG2026

One Sample to Rule Them All: Extreme Data Efficiency in Multidiscipline Reasoning with Reinforcement Learning

Yiyuan Li, Zhen Huang, Yanan Wu +6

The reasoning ability of large language models (LLMs) can be unleashed with reinforcement learning (RL) (OpenAI, 2024; DeepSeek-AI et al., 2025a; Zeng et al., 2025). The success of…