WHODUNIT: Evaluation benchmark for culprit detection in mystery stories

Kshitij Gupta

We present a novel data set, WhoDunIt, to assess the deductive reasoning capabilities of large language models (LLM) within narrative contexts. Constructed from open domain mystery…