Advancing General-Purpose Reasoning Models with Modular Gradient Surgery

Min Cai, Yu Liang, Longzheng Wang +6

Reinforcement learning (RL) has played a central role in recent advances in large reasoning models (LRMs), yielding strong gains in verifiable and open-ended reasoning. However, tr…