11 papers
DelusionEval: Measuring Delusion-Linked Behaviors in AI Chatbots
Jared Moore, Andrea Mock, Yifan Mai +9
Mental health professionals have raised concerns about risks of psychological harm from interaction with large language models (LLMs), including "delusional spirals" in which conce…
FLARE-AI: Flaw Reporting for AI
Shayne Longpre, Elaine Zhu, Carson Ezell +15
Flaw reporting for deployed AI systems is fundamental to identifying system failures and improving AI safety. Yet the AI reporting ecosystem is fragmented: researchers who identify…
Economic Evaluations of Language Models
Alexander Wan, Stephane Hatgis-Kessell, Tomás Aguirre +2
Language models perform economically valuable work, yet they are not currently assessed for how well they perform every economically valuable task. We introduce EconEvals as an ope…
Algorithmic Monocultures in Hiring
Rishi Bommasani, Sarah H. Bana, Kathleen A. Creel +2
Many employers screen job applicants with algorithms built by the same few algorithm vendors. We hypothesize that algorithmic monoculture leads to the same individuals and members…
The 2025 Foundation Model Transparency Index
Alexander Wan, Kevin Klyman, Sayash Kapoor +5
Foundation model developers are among the world's most important companies. As these companies become increasingly consequential, how do their transparency practices evolve? The 20…
International Scientific Report on the Safety of Advanced AI (Interim Report)
Yoshua Bengio, Sören Mindermann, Daniel Privitera +41
This is the interim publication of the first International Scientific Report on the Safety of Advanced AI. The report synthesises the scientific understanding of general-purpose AI…