Where Responsible AI meets Reality: Practitioner Perspectives on Enablers for shifting Organizational Practices

Abstract

Large and ever-evolving technology companies continue to invest more time and resources to incorporate responsible Artificial Intelligence (AI) into production-ready systems to increase algorithmic accountability. This paper examines and seeks to offer a framework for analyzing how organizational culture and structure impact the effectiveness of responsible AI initiatives in practice. We present the results of semi-structured qualitative interviews with practitioners working in industry, investigating common challenges, ethical tensions, and effective enablers for responsible AI initiatives. Focusing on major companies developing or utilizing AI, we have mapped what organizational structures currently support or hinder responsible AI initiatives, what aspirational future processes and structures would best enable effective initiatives, and what key elements comprise the transition from current work practices to the aspirational future.

In Proceedings of the 24th ACM Conference on Computer-Supported Cooperative Work and Social Computing

References in corpus (6)

• Artificial Intelligence: the global landscape of ethics guidelines
• Model Cards for Model Reporting
• Improving fairness in machine learning systems: What do industry practitioners need?
• Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claims
• Diversity and Inclusion Metrics in Subset Selection
• Linking Artificial Intelligence Principles

Cited by in corpus (35)

• Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethics
• Interactive Model Cards: A Human-Centered Approach to Model Documentation
• Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits
• Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutions
• Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practice
• Farsight: Fostering Responsible AI Awareness During AI Application Prototyping
• `It is currently hodgepodge'': Examining AI/ML Practitioners' Challenges during Co-production of Responsible AI Values
• The Situate AI Guidebook: Co-Designing a Toolkit to Support Multi-Stakeholder Early-stage Deliberations Around Public Sector AI Proposals
• Transparent AI Disclosure Obligations: Who, What, When, Where, Why, How
• Seamful XAI: Operationalizing Seamful Design in Explainable AI
• How Platform-User Power Relations Shape Algorithmic Accountability: A Case Study of Instant Loan Platforms and Financially Stressed Users in India
• Inherent Limitations of AI Fairness
• A Scoping Study of Evaluation Practices for Responsible AI Tools: Steps Towards Effectiveness Evaluations
• Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling
• Out of Context: Investigating the Bias and Fairness Concerns of "Artificial Intelligence as a Service"
• Model Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning Experiences
• Artificial Concepts of Artificial Intelligence: Institutional Compliance and Resistance in AI Startups
• Let's Talk Futures: A Literature Review of HCI's Future-Orientation
• Fairness in Agreement With European Values: An Interdisciplinary Perspective on AI Regulation
• Stakeholder Participation for Responsible AI Development: Disconnects Between Guidance and Current Practice
• The "Who", "What", and "How" of Responsible AI Governance: A Systematic Review and Meta-Analysis of (Actor, Stage)-Specific Tools
• SuperNOVA: Design Strategies and Opportunities for Interactive Visualization in Computational Notebooks
• Resolving Ethics Trade-offs in Implementing Responsible AI
• Machine Learning practices and infrastructures
• Supporting Industry Computing Researchers in Assessing, Articulating, and Addressing the Potential Negative Societal Impact of Their Work
• Making the Right Thing: Bridging HCI and Responsible AI in Early-Stage AI Concept Selection
• Beyond Fairness Metrics: Roadblocks and Challenges for Ethical AI in Practice
• Towards Creating Infrastructures for Values and Ethics Work in the Production of Software Technologies
• Identifying the Barriers to Human-Centered Design in the Workplace: Perspectives from UX Professionals
• From Hazard Identification to Controller Design: Proactive and LLM-Supported Safety Engineering for ML-Powered Systems
• Intervenability as a Design Requirement for Autonomy and Oversight within Human-Centered AI
• How Generative AI Empowers Attackers and Defenders Across the Trust & Safety Landscape
• Organization Matters: A Qualitative Study of Organizational Dynamics in Red Teaming Practices for Generative AI
• Talking About the Assumption in the Room
• Compliant But Unsatisfactory: The Gap Between Auditing Standards and Practices for Probabilistic Genotyping Software