`It is currently hodgepodge'': Examining AI/ML Practitioners' Challenges during Co-production of Responsible AI Values
arXiv:2307.10221 · doi:10.1145/3544548.3580903
Abstract
Recently, the AI/ML research community has indicated an urgent need to establish Responsible AI (RAI) values and practices as part of the AI/ML lifecycle. Several organizations and communities are responding to this call by sharing RAI guidelines. However, there are gaps in awareness, deliberation, and execution of such practices for multi-disciplinary ML practitioners. This work contributes to the discussion by unpacking co-production challenges faced by practitioners as they align their RAI values. We interviewed 23 individuals, across 10 organizations, tasked to ship AI/ML based products while upholding RAI norms and found that both top-down and bottom-up institutional structures create burden for different roles preventing them from upholding RAI values, a challenge that is further exacerbated when executing conflicted values. We share multiple value levers used as strategies by the practitioners to resolve their challenges. We end our paper with recommendations for inclusive and equitable RAI value-practices, creating supportive organizational structures and opportunities to further aid practitioners.
References in corpus (13)
- Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligence
- What Does Explainable AI Really Mean? A New Conceptualization of Perspectives
- Problem Formulation and Fairness
- "Brilliant AI Doctor" in Rural China: Tensions and Challenges in AI-Powered CDSS Deployment
- The Forgotten Margins of AI Ethics
- Envisioning Communities: A Participatory Approach Towards AI for Social Good
- Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems
- Modeling Assumptions Clash with the Real World: Transparency, Equity, and Community Challenges for Student Assignment Algorithms
- Artificial Intelligence for Social Good: A Survey
- Black Feminist Musings on Algorithmic Oppression
- The Role of Cooperation in Responsible AI Development
- Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and Stir"
- Enabling Value Sensitive AI Systems through Participatory Design Fictions