4 papers
A Battery for AI Propensity Measurement: Rubrics, Synthetic Item Banks, and Annotations
Peter Romero, Haotian Li, Hugo Save +8
We release a battery of 28 propensities for AI research, with expert-written rubrics, synthetic datasets, and annotated demand intervals, built with the method of Romero-Alvarado e…
Shortcut Learning in Legal Judgment Prediction: Empirical Evidence from the UK Employment Tribunal
Joe Watson, Joana Ribeiro de Faria, Marcus Tomalin +6
Current Legal Judgment Prediction (LJP) is constrained by its reliance on post-hoc judicial materials, increasing the likelihood that models perform retrospective classification ra…
Augmenting Rating-Scale Measures with Text-Derived Items Using the Information-Determined Scoring (IDS) Framework
Joe Watson, Ivan O'Connor, Chia-Wen Chen +3
Psychological assessments commonly rely on rating-scale items, which require respondents to condense complex experiences into predefined categories. Although rich, unstructured tex…
Building Gradient by Gradient: Decentralised Energy Functions for Bimanual Robot Assembly
Alexander L. Mitchell, Joe Watson, Ingmar Posner
There are many challenges in bimanual assembly, including high-level sequencing, multi-robot coordination, and low-level, contact-rich operations such as component mating. Task and…