Arctic Questions, Missing Answers: A Dataset and Benchmark for LLM Abstention in Arctic Science

Benjamin Wilcox, Dawei Gao, Pradeeban Kathiravelu +3

Large language models (LLMs) should abstain from scientific multiple-choice questions when no option is valid, but frequent abstention alone does not demonstrate sensitivity to ans…