activity
20202026
most citedBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

565 citations · 698 across the 12 of their papers we have counts for

collaborators
Showing 2023Show all

5 papers · 1 filter

cs.AI2023★ 1 cited

The Animal-AI Environment: A Virtual Laboratory For Comparative Cognition and Artificial Intelligence Research

Konstantinos Voudouris, Ibrahim Alhas, Wout Schellaert +11

The Animal-AI Environment is a unique game-based research platform designed to facilitate collaboration between the artificial intelligence and comparative cognition research commu…

cs.CY2023★ 1 cited

An International Consortium for Evaluations of Societal-Scale Risks from Advanced AI

Ross Gruetzemacher, Alan Chan, Kevin Frazier +11

Given rapid progress toward advanced AI and risks from frontier AI systems (advanced AI systems pushing the boundaries of the AI capabilities frontier), the creation and implementa…

cs.AI2023★ 4 cited

Predictable Artificial Intelligence

Lexin Zhou, Pablo A. Moreno-Casares, Fernando Martínez-Plumed +12

We introduce the fundamental ideas and challenges of Predictable AI, a nascent research area that explores the ways in which we can anticipate key validity indicators (e.g., perfor…

cs.AI2023★ 1 cited

Inferring Capabilities from Task Performance with Bayesian Triangulation

John Burden, Konstantinos Voudouris, Ryan Burnell +3

As machine learning models become more general, we need to characterise them in richer, more meaningful ways. We describe a method to infer the cognitive profile of a system from d…

cs.CY2023★ 124 cited

Harms from Increasingly Agentic Algorithmic Systems

Alan Chan, Rebecca Salganik, Alva Markelius +19

Research in Fairness, Accountability, Transparency, and Ethics (FATE) has established many sources and forms of algorithmic harm, in domains as diverse as health care, finance, pol…