Pareto-Optimal Offline Reinforcement Learning via Smooth Tchebycheff Scalarization

Aadyot Bhatnagar, Peter Mørch Groth, Ali Madani +1

Large language models can be aligned with human preferences through offline reinforcement learning (RL) on small labeled datasets. While single-objective alignment is well-studied,…