Bradley-Terry Policy Optimization for Generative Preference Modeling

Shengyu Feng, Yun He, Shuang Ma +12

Reinforcement learning (RL) has recently proven effective at scaling chain-of-thought (CoT) reasoning in large language models for tasks with verifiable answers. However, extending…