Quality Determines Direction, Length Shapes Magnitude: Length Control for Open-Ended Reinforcement Learning

Zijun Weng, Zhongan Bi, Xuanang Gao +5

Reinforcement learning (RL) changes not only what language models say, but also how much they say, often increasing response length at the cost of token efficiency. Controlling thi…