Overwhelmed by Choice: Studying LLM Decision Making at Scale

Yu-Chi Lin, Aryan Seth, Anshul Aravind +4

Multiple-choice and candidate-selection evaluations are widely used to assess LLM reasoning and decision-making, yet most benchmarks contain relatively small candidate sets. It rem…