LLM-Derived Preference Judgments Are Not Self-Consistent

Matthew T. Ford, Francis Bahk, Jingjing Wang +4

Agents increasingly interpret a person's natural-language preferences by querying an LLM for numerical preference judgments, e.g., by asking how much the person would be willing to…