The social dilemma of autonomous vehicles

Abstract

Autonomous Vehicles (AVs) should reduce traffic accidents, but they will sometimes have to choose between two evils-for example, running over pedestrians or sacrificing itself and its passenger to save them. Defining the algorithms that will help AVs make these moral decisions is a formidable challenge. We found that participants to six MTurk studies approved of utilitarian AVs (that sacrifice their passengers for the greater good), and would like others to buy them, but they would themselves prefer to ride in AVs that protect their passengers at all costs. They would disapprove of enforcing utilitarian AVs, and would be less willing to buy such a regulated AV. Accordingly, regulating for utilitarian algorithms may paradoxically increase casualties by postponing the adoption of a safer technology.

14 pages, 3 figures

References in corpus (1)

• Machine Ethics and Automated Vehicles

Cited by in corpus (71)

• The role of artificial intelligence in achieving the Sustainable Development Goals
• A Survey of Autonomous Driving: Common Practices and Emerging Technologies
• What Do We Want From Explainable Artificial Intelligence (XAI)? -- A Stakeholder Perspective on XAI and a Conceptual Model Guiding Interdisciplinary XAI Research
• Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveys
• Society-in-the-Loop: Programming the Algorithmic Social Contract
• Autonomous Vehicles for Smart and Sustainable Cities: An In-Depth Exploration of Privacy and Cybersecurity Implications
• Social Interactions for Autonomous Driving: A Review and Perspectives
• Algorithmic decision-making in AVs: Understanding ethical and technical concerns for smart cities
• Away from Trolley Problems and Toward Risk Management
• Adapting a Kidney Exchange Algorithm to Align with Human Values
• GPT-4 Enhanced Multimodal Grounding for Autonomous Driving: Leveraging Cross-Modal Attention with Large Language Models
• Human Perceptions on Moral Responsibility of AI: A Case Study in AI-Assisted Bail Decision-Making
• Ethical Implications of Social Internet of Vehicles Systems
• A Greedy Search Tree Heuristic for Symbolic Regression
• Assessing the Safety and Reliability of Autonomous Vehicles from Road Testing
• Towards Moral Autonomous Systems
• How Do Fairness Definitions Fare? Examining Public Attitudes Towards Algorithmic Definitions of Fairness
• Scalable End-to-End Autonomous Vehicle Testing via Rare-event Simulation
• Landscape of Machine Implemented Ethics
• Ethics of Technology needs more Political Philosophy
• Demographics and discussion influence views on algorithmic fairness
• An Online Mechanism for Ridesharing in Autonomous Mobility-on-Demand Systems
• Interpretable Multi-Objective Reinforcement Learning through Policy Orchestration
• Enabling Value Sensitive AI Systems through Participatory Design Fictions
• Closing the AI Knowledge Gap
• Consequentialist conditional cooperation in social dilemmas with imperfect information
• Facilitating Cooperation in Human-Agent Hybrid Populations through Autonomous Agents
• Impossibility and Uncertainty Theorems in AI Value Alignment (or why your AGI should not have a utility function)
• The social dilemma in artificial intelligence development and why we have to solve it
• Beyond Near- and Long-Term: Towards a Clearer Account of Research Priorities in AI Ethics and Society
• Norms for Beneficial A.I.: A Computational Analysis of the Societal Value Alignment Problem
• Macro Ethics Principles for Responsible AI Systems: Taxonomy and Future Directions
• Moral Dilemmas for Moral Machines
• The Science Fiction Science Method
• Responsible AI: Gender bias assessment in emotion recognition
• A Computational Model of Commonsense Moral Decision Making
• Building Ethics into Artificial Intelligence
• Large-scale moral machine experiment on large language models
• Ethical Considerations in Artificial Intelligence Courses
• When Is It Acceptable to Break the Rules? Knowledge Representation of Moral Judgement Based on Empirical Data
• Reasonable Machines: A Research Manifesto
• Machine learning and behavioral economics for personalized choice architecture
• Have a break from making decisions, have a MARS: The Multi-valued Action Reasoning System
• People Attribute Purpose to Autonomous Vehicles When Explaining Their Behavior: Insights from Cognitive Science for Explainable AI
• Advising Autonomous Cars about the Rules of the Road
• What About Applied Fairness?
• Towards a Digital Highway Code using Formal Modelling and Verification of Timed Automata
• Can AI Model the Complexities of Human Moral Decision-Making? A Qualitative Study of Kidney Allocation Decisions
• Towards human-compatible autonomous car: A study of non-verbal Turing test in automated driving with affective transition modelling
• Simulating Crowds and Autonomous Vehicles
• Developing and evaluating an human-automation shared control takeover strategy based on Human-in-the-loop driving simulation
• Using experimental game theory to transit human values to ethical AI
• A Negotiation-based Right-of-way Assignment Strategy to Ensure Traffic Safety and Efficiency in Lane Change
• Task-Motion Planning for Safe and Efficient Urban Driving
• TiEV: The Tongji Intelligent Electric Vehicle in the Intelligent Vehicle Future Challenge of China
• Randomized Classifiers vs Human Decision-Makers: Trustworthy AI May Have to Act Randomly and Society Seems to Accept This
• Verisimilar Percept Sequences Tests for Autonomous Driving Intelligent Agent Assessment
• What might matter in autonomous cars adoption: first person versus third person scenarios
• Heuristic-Based Weak Learning for Automated Decision-Making
• Scaling Laws for Moral Machine Judgment in Large Language Models
• A Review of Autonomous Road Vehicle Integrated Approaches to an Emergency Obstacle Avoidance Maneuver
• Controllable Planning, Responsibility, and Information in Automatic Driving Technology
• Digital Divide and Social Dilemma of Privacy Preservation
• Social Responsibility of Algorithms
• The Controllability of Planning, Responsibility, and Security in Automatic Driving Technology
• Aligning with Heterogeneous Preferences for Kidney Exchange
• Good for the Many or Best for the Few? A Dilemma in the Design of Algorithmic Advice
• Towards an unanimous international regulatory body for responsible use of Artificial Intelligence [UIRB-AI]
• Risk-Aware Reasoning for Autonomous Vehicles
• Egoistic Incentives Based on Zero-Determinant Alliances for Large-Scale Systems
• Verlässliche Software im 21. Jahrhundert