Pointwise or Pairwise: When Do Pairwise Losses Help Reward Learning, Provably?

Junghyun Lee, Minsoo Ha, Sanghwa Kim +4

Pairwise losses are increasingly used for reward learning even when pointwise rewards are observed, with mixed empirical results. When and why do pairwise losses outperform pointwi…