How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case Study

Abstract

The development of AI applications is a multidisciplinary effort, involving multiple roles collaborating with the AI developers, an umbrella term we use to include data scientists and other AI-adjacent roles on the same team. During these collaborations, there is a knowledge mismatch between AI developers, who are skilled in data science, and external stakeholders who are typically not. This difference leads to communication gaps, and the onus falls on AI developers to explain data science concepts to their collaborators. In this paper, we report on a study including analyses of both interviews with AI developers and artifacts they produced for communication. Using the analytic lens of shared mental models, we report on the types of communication gaps that AI developers face, how AI developers communicate across disciplinary and organizational boundaries, and how they simultaneously manage issues regarding trust and expectations.

25 pages, 7 figures, 4 tables

References in corpus (7)

• Model Cards for Model Reporting
• Human-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AI
• Unremarkable AI: Fitting Intelligent Decision Support into Critical, Clinical Decision-Making Processes
• Software Engineering Challenges of Deep Learning
• Trust in Data Science: Collaboration, Translation, and Accountability in Corporate Data Science Projects
• How Data Scientists Work Together With Domain Experts in Scientific Collaborations: To Find The Right Answer Or To Ask The Right Question?
• AutoDS: Towards Human-Centered Automation of Data Science

Cited by in corpus (22)

• Investigating How Practitioners Use Human-AI Guidelines: A Case Study on the People + AI Guidebook
• Documentation Matters: Human-Centered AI System to Assist Data Science Code Documentation in Computational Notebooks
• Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for Radiology
• AutoDS: Towards Human-Centered Automation of Data Science
• Telling Stories from Computational Notebooks: AI-Assisted Presentation Slides Creation for Presenting Data Science Work
• "If I Had All the Time in the World": Ophthalmologists' Perceptions of Anchoring Bias Mitigation in Clinical AI Support
• Notable: On-the-fly Assistant for Data Storytelling in Computational Notebooks
• Sketching AI Concepts with Capabilities and Examples: AI Innovation in the Intensive Care Unit
• Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Design
• Model Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning Experiences
• Bridging MDE and AI: A Systematic Review of Domain-Specific Languages and Model-Driven Practices in AI Software Systems Engineering
• Model LineUpper: Supporting Interactive Model Comparison at Multiple Levels for AutoML
• The Value-Sensitive Conversational Agent Co-Design Framework
• Why is AI not a Panacea for Data Workers? An Interview Study on Human-AI Collaboration in Data Storytelling
• Supporting Industry Computing Researchers in Assessing, Articulating, and Addressing the Potential Negative Societal Impact of Their Work
• AINeedsPlanner: A Workbook to Support Effective Collaboration Between AI Experts and Clients
• An Interdisciplinary Perspective of the Built-Environment Microbiome
• A Case Study on AI Engineering Practices: Developing an Autonomous Stock Trading System
• Translating Emotions to Annotations -- A Participant Perspective of Physiological Emotion Data Collection
• Towards Feature Engineering with Human and AI's Knowledge: Understanding Data Science Practitioners' Perceptions in Human&AI-Assisted Feature Engineering Design
• Developing and Evaluating a Design Method for Positive Artificial Intelligence
• "We'll have to see how it works": An interview study to understand collaborative practices in interdisciplinary artificial intelligence and healthcare research