How Does RL Post-training Induce Skill Composition? A Case Study on Countdown

Simon Park, Simran Kaur, Sanjeev Arora

While reinforcement learning (RL) successfully enhances reasoning in large language models, its role in fostering compositional generalization (the ability to synthesize novel skil…