4 papers
An International Agreement to Prevent the Premature Creation of Artificial Superintelligence
Aaron Scher, David Abecassis, Peter Barnett +1
Many experts argue that premature development of artificial superintelligence (ASI) poses catastrophic risks, including the risk of human extinction from misaligned ASI, geopolitic…
Compute Requirements for Algorithmic Innovation in Frontier AI Models
Peter Barnett
Algorithmic innovation in the pretraining of large language models has driven a massive reduction in the total compute required to reach a given level of capability. In this paper…
Technical Requirements for Halting Dangerous AI Activities
Peter Barnett, Aaron Scher, David Abecassis
The rapid development of AI systems poses unprecedented risks, including loss of control, misuse, geopolitical instability, and concentration of power. To navigate these risks and…
AI Governance to Avoid Extinction: The Strategic Landscape and Actionable Research Questions
Peter Barnett, Aaron Scher
Humanity appears to be on course to soon develop AI systems that substantially outperform human experts in all cognitive domains and activities. We believe the default trajectory h…