Ethics of generative AI and manipulation: a design-oriented research agenda

Abstract

Generative AI enables automated, effective manipulation at scale. Despite the growing general ethical discussion around generative AI, the specific manipulation risks remain inadequately investigated. This article outlines essential inquiries encompassing conceptual, empirical, and design dimensions of manipulation, pivotal for comprehending and curbing manipulation risks. By highlighting these questions, the article underscores the necessity of an appropriate conceptualisation of manipulation to ensure the responsible development of Generative AI technologies.

References in corpus (5)

• Training language models to follow instructions with human feedback
• Artificial Intelligence, Values and Alignment
• Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigations
• A General Language Assistant as a Laboratory for Alignment
• Algorithmic Transparency and Manipulation

Cited by in corpus (1)

• Deception and Manipulation in Generative AI