23 citations · 23 across the 2 of their papers we have counts for
3 papers
The LALA Benchmark: Evaluating Literary and Linguistic Analysis in LLMs
Michael Foster, Barbara McGillivray, Gard B. Jenset +7
We introduce the Literature and Linguistics Analysis Benchmark (LALA), comprising 236 open-ended questions written by experts in linguistics and literary studies, together with exp…
A Browser-based Open Source Assistant for Multimodal Content Verification
Rosanna Milner, Michael Foster, Twin Karmakharm +5
Disinformation and false content produced by generative AI pose a significant challenge for journalists and fact-checkers who must rapidly verify digital media information. While t…
Humanity's Last Exam
Long Phan, Alice Gatti, Ziwen Han +1168
Benchmarks are important tools for tracking the rapid advancements in large language model (LLM) capabilities. However, benchmarks are not keeping pace in difficulty: LLMs now achi…