Preprint Open access
Arctic Questions, Missing Answers: A Dataset and Benchmark for LLM Abstention in Arctic Science
Large language models (LLMs) should abstain from scientific multiple-choice questions when no option is valid, but frequent abstention alone does not demonstrate sensitivity to answer availability. We introduce ArcticQA, a dataset of 194 questions derived from primary Arctic research, with automated checks of answer su …