Sharpening Tax in Post-Training

Changdae Oh, Qi Zeng, Qi Qi +7

An emerging hypothesis about reinforcement learning (RL) post-training of large language models (LLMs) is that it merely sharpens existing behaviors of a base model, improving sing…