SP3O: Reinforcement Learning from Segment Preferences without Reward Modeling

Evan Assmus, Qining Zhang, Lei Ying

Preference-based reinforcement learning (PbRL) for general stochastic MDPs often requires training a reward model. Existing reward-model-free methods are either restricted to bandi…