activity
20202026
most citedModel evaluation for extreme risks

59 citations · 96 across the 7 of their papers we have counts for

collaborators

7 papers

cs.AI2026

Diversity is the Strength of the AI Crowd

Matthew Aitchison, Scott Jeen, Toby Shevlane +1

Top AI forecasting systems are approaching superforecaster-level accuracy on future world events, but still rely primarily on off-the-shelf LLMs combined with forecasting-specific…

cs.CV2024

VISTA: A Visual and Textual Attention Dataset for Interpreting Multimodal Models

Harshit, Tolga Tasdizen

The recent developments in deep learning led to the integration of natural language processing (NLP) with computer vision, resulting in powerful integrated Vision and Language Mode…

cs.CY2024★ 9 cited

A Mechanism-Based Approach to Mitigating Harms from Persuasive Generative AI

Seliem El-Sayed, Canfer Akbulut, Amanda McCroskery +17

Recent generative AI systems have demonstrated more advanced persuasive capabilities and are increasingly permeating areas of life where they can influence decision-making. Generat…

cs.LG2024★ 11 cited

Evaluating Frontier Models for Dangerous Capabilities

Mary Phuong, Matthew Aitchison, Elliot Catt +24

To understand the risks posed by a new AI system, we must understand what it can and cannot do. Building on prior work, we introduce a programme of new "dangerous capability" evalu…

cs.AI2023★ 59 cited

Model evaluation for extreme risks

Toby Shevlane, Sebastian Farquhar, Ben Garfinkel +18

Current approaches to building general-purpose AI systems tend to produce systems with both beneficial and harmful capabilities. Further progress in AI development could lead to ca…

cs.AI2022★ 9 cited

Structured access: an emerging paradigm for safe AI deployment

Toby Shevlane

Structured access is an emerging paradigm for the safe deployment of artificial intelligence (AI). Instead of openly disseminating AI systems, developers facilitate controlled, arm…

cs.CY2020★ 8 cited

The Offense-Defense Balance of Scientific Knowledge: Does Publishing AI Research Reduce Misuse?

Toby Shevlane, Allan Dafoe

There is growing concern over the potential misuse of artificial intelligence (AI) research. Publishing scientific research can facilitate misuse of the technology, but the researc…