Diffusion Reward Models

Xiangyang Wang, Bingxiang He, Zeyuan Liu +14

Reward models underpin the alignment of large language models, yet the dominant designs reduce each prompt--response pair to a point estimate or to a distribution from a fixed para…