Axiom Satisfiability of Linear Rewards in Alignment

Soumya Nasipuri, Sayak Ray Chowdhury, Sanjukta Roy

Learning from human preference data is the dominant route to aligning language models with human values. In linear social choice, where rewards are linear in a fixed feature repres…