activity
20212025
most citedBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

565 citations · 2.2k across the 25 of their papers we have counts for

collaborators
Showing 2023Show all

5 papers · 1 filter

cs.CL2023★ 10 cited

Evaluating and Mitigating Discrimination in Language Model Decisions

Alex Tamkin, Amanda Askell, Liane Lovitt +6

As language models (LMs) advance, interest is growing in applying them to high-stakes societal decisions, such as determining financing or housing eligibility. However, their poten…

cs.CY2023★ 3 cited

Report of the 1st Workshop on Generative AI and Law

A. Feder Cooper, Katherine Lee, James Grimmelmann +32

This report presents the takeaways of the inaugural Workshop on Generative AI and Law (GenLaw), held in July 2023. A cross-disciplinary group of practitioners and scholars from com…

cs.SI2023★ 21 cited

Opportunities and Risks of LLMs for Scalable Deliberation with Polis

Christopher T. Small, Ivan Vendrov, Esin Durmus +6

Polis is a platform that leverages machine intelligence to scale up deliberative processes. In this paper, we explore the opportunities and risks associated with applying Large Lan…

cs.CL2023★ 45 cited

Towards Measuring the Representation of Subjective Global Opinions in Language Models

Esin Durmus, Karina Nguyen, Thomas I. Liao +15

Large language models (LLMs) may not equitably represent diverse global perspectives on societal issues. In this paper, we develop a quantitative framework to evaluate whose opinio…

cs.CL2023★ 53 cited

The Capacity for Moral Self-Correction in Large Language Models

Deep Ganguli, Amanda Askell, Nicholas Schiefer +46

We test the hypothesis that language models trained with reinforcement learning from human feedback (RLHF) have the capability to "morally self-correct" -- to avoid producing harmf…