Abstract Priorities, Concrete Rewards: How Stated Preferences Relate to What People Reward in AI Responses

Zihan Chen, Lei Nico Zheng, Di Zhu

AI assistants built on large language models (LLMs) are trained on human feedback and increasingly personalized to users' stated preferences. Yet how closely these preferences refl…