activity
20202024
most citedModel evaluation for extreme risks

59 citations · 214 across the 11 of their papers we have counts for

collaborators

11 papers

cs.CY2024★ 3 cited

How will advanced AI systems impact democracy?

Christopher Summerfield, Lisa Argyle, Michiel Bakker +20

Advanced AI systems capable of generating humanlike text and multimodal content are now widely available. In this paper, we discuss the impacts that generative artificial intellige…

cs.CY2024★ 20 cited

Towards Responsible Development of Generative AI for Education: An Evaluation-Driven Approach

Irina Jurenka, Markus Kunesch, Kevin R. McKee +71

A major challenge facing the world is the provision of equitable and universal access to quality education. Recent advances in generative AI (gen AI) have created excitement about…

cs.AI2024★ 15 cited

Generative AI Misuse: A Taxonomy of Tactics and Insights from Real-World Data

Nahema Marchal, Rachel Xu, Rasmi Elasmar +3

Generative, multimodal artificial intelligence (GenAI) offers transformative potential across industries, but its misuse poses significant risks. Prior research has shed light on t…

cs.CY2024

(Unfair) Norms in Fairness Research: A Meta-Analysis

Jennifer Chien, A. Stevie Bergman, Kevin R. McKee +5

Algorithmic fairness has emerged as a critical concern in artificial intelligence (AI) research. However, the development of fair AI systems is not an objective process. Fairness i…

cs.AI2024

STAR: SocioTechnical Approach to Red Teaming Language Models

Laura Weidinger, John Mellor, Bernat Guillen Pegueroles +9

This research introduces STAR, a sociotechnical framework that improves on current best practices for red teaming safety of large language models. STAR makes two key contributions:…

cs.CY2024★ 51 cited

The Ethics of Advanced AI Assistants

Iason Gabriel, Arianna Manzini, Geoff Keeling +54

This paper focuses on the opportunities and the ethical and societal risks posed by advanced AI assistants. We define advanced AI assistants as artificial agents with natural langu…

cs.CY2024★ 9 cited

A Mechanism-Based Approach to Mitigating Harms from Persuasive Generative AI

Seliem El-Sayed, Canfer Akbulut, Amanda McCroskery +17

Recent generative AI systems have demonstrated more advanced persuasive capabilities and are increasingly permeating areas of life where they can influence decision-making. Generat…

cs.AI2023★ 44 cited

Sociotechnical Safety Evaluation of Generative AI Systems

Laura Weidinger, Maribeth Rauh, Nahema Marchal +10

Generative AI systems produce a range of risks. To ensure the safety of generative AI systems, these risks must be evaluated. In this paper, we make two main contributions toward e…

cs.AI2023★ 59 cited

Model evaluation for extreme risks

Toby Shevlane, Sebastian Farquhar, Ben Garfinkel +18

Current approaches to building general-purpose AI systems tend to produce systems with both beneficial and harmful capabilities. Further progress in AI development could lead to ca…

cs.SI2020★ 4 cited

Junk News & Information Sharing During the 2019 UK General Election

Nahema Marchal, Bence Kollanyi, Lisa-Maria Neudert +2

Today, an estimated 75% of the British public access information about politics and public life online, and 40% do so via social media. With this context in mind, we investigate in…

cs.SI2020★ 9 cited

Echo Chambers Exist! (But They're Full of Opposing Views)

Jonathan Bright, Nahema Marchal, Bharath Ganesh +1

The theory of echo chambers, which suggests that online political discussions take place in conditions of ideological homogeneity, has recently gained popularity as an explanation…