When Do LLM Preferences Predict Downstream Behavior?

Katarina Slama, Alexandra Souly, Dishank Bansal +3

Preference-driven behavior in LLMs may be a necessary precondition for AI misalignment such as sandbagging: models cannot strategically pursue misaligned goals unless their behavio…