3 papers
cs.LG2025
Shrinking the Variance: Shrinkage Baselines for Reinforcement Learning with Verifiable Rewards
Guanning Zeng, Zhaoyi Zhou, Daman Arora +1
Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a powerful paradigm for post-training large reasoning models (LRMs) using policy-gradient methods such as GRPO.…
cs.LG2025
SPEED-RL: Faster Training of Reasoning Models via Online Curriculum Learning
Ruiqi Zhang, Daman Arora, Song Mei +1
Training large language models with reinforcement learning (RL) against verifiable rewards significantly enhances their reasoning abilities, yet remains computationally expensive d…
cs.LG2025
Training Language Models to Reason Efficiently
Daman Arora, Andrea Zanette
Scaling model size and training data has led to great advances in the performance of Large Language Models (LLMs). However, the diminishing returns of this approach necessitate alt…