The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigation

Abstract

This report surveys the landscape of potential security threats from malicious uses of AI, and proposes ways to better forecast, prevent, and mitigate these threats. After analyzing the ways in which AI may influence the threat landscape in the digital, physical, and political domains, we make four high-level recommendations for AI researchers and other stakeholders. We also suggest several promising areas for further research that could expand the portfolio of defenses, or make attacks less effective or harder to execute. Finally, we discuss, but do not conclusively resolve, the long-term equilibrium of attackers and defenders.

Cited by in corpus (15)

• The Fallacy of AI Functionality
• Adversarial Examples: Opportunities and Challenges
• Risk management in the Artificial Intelligence Act
• Anatomy of an AI-powered malicious social botnet
• Defining the scope of AI regulations
• FakeNews: GAN-based generation of realistic 3D volumetric data -- A systematic review and taxonomy
• A Rapid Review of Responsible AI frameworks: How to guide the development of ethical AI
• The Ethical Implications of Generative Audio Models: A Systematic Literature Review
• CaloMan: Fast generation of calorimeter showers with density estimation on learned manifolds
• Studying the Transfer of Biases from Programmers to Programs
• EvilModel 2.0: Bringing Neural Network Models into Malware Attacks
• AI Challenges for Society and Ethics
• CERN for AI: A Theoretical Framework for Autonomous Simulation-Based Artificial Intelligence Testing and Alignment
• Foundations for the Future: Institution building for the purpose of Artificial Intelligence governance
• Making the Right Thing: Bridging HCI and Responsible AI in Early-Stage AI Concept Selection