267 citations · 287 across the 6 of their papers we have counts for
6 papers
Societal Capacity Assessment Framework: Measuring Resilience to Inform Advanced AI Risk Management
Milan Gandhi, Peter Cihon, Owen Larter +1
Risk assessments for advanced AI systems require evaluating both the models themselves and their deployment contexts. We introduce the Societal Capacity Assessment Framework (SCAF)…
Measuring AI agent autonomy: Towards a scalable approach with code inspection
Peter Cihon, Merlin Stein, Gagan Bansal +2
AI agents are AI systems that can achieve complex goals autonomously. Assessing the level of agent autonomy is crucial for understanding both their potential benefits and risks. Cu…
Measuring Software Innovation with Open Source Software Development Data
Eva Maxfield Brown, Cailean Osborne, Peter Cihon +4
Existing innovation metrics inadequately capture software innovation, creating blind spots for researchers and policymakers seeking to understand and foster technological innovatio…
On the Societal Impact of Open Foundation Models
Sayash Kapoor, Rishi Bommasani, Kevin Klyman +22
Foundation models are powerful technologies: how they are released publicly directly shapes their societal impact. In this position paper, we focus on open foundation models, defin…
Open-Sourcing Highly Capable Foundation Models: An evaluation of risks, benefits, and alternative methods for pursuing open-source objectives
Elizabeth Seger, Noemi Dreksler, Richard Moulange +19
Recent decisions by leading AI labs to either open-source their models or to restrict access to their models has sparked debate about whether, and how, increasingly capable AI mode…
The Impact of AI on Developer Productivity: Evidence from GitHub Copilot
Sida Peng, Eirini Kalliamvakou, Peter Cihon +1
Generative AI tools hold promise to increase human productivity. This paper presents results from a controlled experiment with GitHub Copilot, an AI pair programmer. Recruited soft…