1 citations · 1 across the 5 of their papers we have counts for
4 papers · 1 filter
Open Problems in AI Incident Governance
Harleen Kaur Sidhu, Rebecca Scholefield, Nour Annan +5
AI systems may produce failures after deployment that pre-deployment safety assessments do not anticipate. Managing these failures requires what we refer to as adequate \textit{AI…
The Case for ESM3 as a General-Purpose AI Model with Systemic Risk Under the EU AI Act
Taro Qureshi, Jacob Griffith, Koen Holtman +3
Due to ambiguity in the wording of the EU AI Act, we examine the question of to what extent frontier biological foundation models such as ESM3 are subject to obligations for genera…
Principles and Guidelines for Randomized Controlled Trials in AI Evaluation
Christopher Kelly, Angelica Chowdhury, Alexandra Campili +5
This work establishes a framework for standardizing AI evaluation RCTs (sometimes called human uplift studies). Drawing on established practices from disciplines with established R…
Deprecating Benchmarks: Criteria and Framework
Ayrton San Joaquin, Rokas Gipiškis, Leon Staufer +1
As frontier artificial intelligence (AI) models rapidly advance, benchmarks are integral to comparing different models and measuring their progress in different task-specific domai…