Modularized Reinforcement Learning on LLMs: From MDP Creation to Exploration and Learning

Zhao Yang, Yuxuan Jiang, Ting-Chih Chen +18

Reinforcement learning (RL) has become central to LLM post-training, yet the methods that dominate current pipelines, PPO and GRPO, represent only a narrow slice of what RL offers.…