Value-Free Policy Optimization via Reward Partitioning

Bilal Faye, Hanane Azzag, Mustapha Lebbah

Single-trajectory preference optimization methods learn from datasets of ((prompt, response, reward)) tuples, offering a practical alternative to pairwise preference learning by di…