Latent Adversarial Regularization for Offline Preference Optimization

Enyi Jiang, Yibo Jacky Zhang, Yinglun Xu +3

Learning from human feedback typically relies on preference optimization that constrains policy updates through token-level regularization. However, preference optimization for lan…