Shorten After You're Right: Lazy Length Penalties for Reasoning RL

Danlong Yuan, Tian Xie, Shaohan Huang +5

Large reasoning models, such as OpenAI o1 or DeepSeek R1, have demonstrated remarkable performance on reasoning tasks but often incur a long reasoning path with significant memory…