activity
20242026
most citedTowards Reproducible LLM Evaluation: Quantifying Uncertainty in LLM Benchmark Scores

4 citations · 8 across the 5 of their papers we have counts for

collaborators
Showing 2025Show all

2 papers · 1 filter

cs.AI2025

DecompSR: A dataset for decomposed analyses of compositional multihop spatial reasoning

Lachlan McPheat, Navdeep Kaur, Robert Blackwell +3

We introduce DecompSR, decomposed spatial reasoning, a large benchmark dataset (over 5m datapoints) and generation framework designed to analyse compositional spatial reasoning abi…

cs.CL2025

Evaluating the Ability of Large Language Models to Reason about Cardinal Directions, Revisited

Anthony G Cohn, Robert E Blackwell

We investigate the abilities of 28 Large language Models (LLMs) to reason about cardinal directions (CDs) using a benchmark generated from a set of templates, extensively testing a…