The Model Says Walk: Measuring whether LLMs Condition on Hidden Constraints

Yubo Li, Lu Zhang, Tianchong Jiang +2

Asked whether to walk or drive to a car wash 50 m away, most language models say walk, forgetting that the car has to be there. Such failures are usually measured by accuracy on qu…