How much of a measured AI preference is the model, and how much is the instrument?

Jason Hung

Model welfare research infers what a model prefers from the answers returned to prompts written to elicit preferences. Keeling et al. (2024), Mazeika et al. (2025), Mikaelson et al…