How Data Scientists Work Together With Domain Experts in Scientific Collaborations: To Find The Right Answer Or To Ask The Right Question?

Abstract

In recent years there has been an increasing trend in which data scientists and domain experts work together to tackle complex scientific questions. However, such collaborations often face challenges. In this paper, we aim to decipher this collaboration complexity through a semi-structured interview study with 22 interviewees from teams of bio-medical scientists collaborating with data scientists. In the analysis, we adopt the Olsons' four-dimensions framework proposed in Distance Matters to code interview transcripts. Our findings suggest that besides the glitches in the collaboration readiness, technology readiness, and coupling of work dimensions, the tensions that exist in the common ground building process influence the collaboration outcomes, and then persist in the actual collaboration process. In contrast to prior works' general account of building a high level of common ground, the breakdowns of content common ground together with the strengthen of process common ground in this process is more beneficial for scientific discovery. We discuss why that is and what the design suggestions are, and conclude the paper with future directions and limitations.

References in corpus (2)

• OpenML: networked science in machine learning
• Survival Prediction with Limited Features: a Top Performing Approach from the DREAM ALS Stratification Prize4Life Challenge

Cited by in corpus (19)

• Human-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AI
• How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case Study
• Investigating How Practitioners Use Human-AI Guidelines: A Case Study on the People + AI Guidebook
• AutoDS: Towards Human-Centered Automation of Data Science
• AutoAIViz: Opening the Blackbox of Automated Artificial Intelligence with Conditional Parallel Coordinates
• Telling Stories from Computational Notebooks: AI-Assisted Presentation Slides Creation for Presenting Data Science Work
• Facilitating Knowledge Sharing from Domain Experts to Data Scientists for Building NLP Models
• Competent but Rigid: Identifying the Gap in Empowering AI to Participate Equally in Group Decision-Making
• Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Design
• Using HCI in Cross-Disciplinary Teams: A Case Study of Academic Collaboration in HCI-Health Teams in the US Using a Team Science Perspective
• A "Distance Matters" Paradox: Facilitating Intra-Team Collaboration Can Harm Inter-Team Collaboration
• Why is AI not a Panacea for Data Workers? An Interview Study on Human-AI Collaboration in Data Storytelling
• Dirty Data in the Newsroom: Comparing Data Preparation in Journalism and Data Science
• Enabling Collaborative Data Science Development with the Ballet Framework
• AINeedsPlanner: A Workbook to Support Effective Collaboration Between AI Experts and Clients
• Exploring the Innovation Opportunities for Pre-trained Models
• It's a Complete Haystack: Understanding Dependency Management Needs in Computer-Aided Design
• Steering AI-Driven Personalization of Scientific Text for General Audiences
• "We'll have to see how it works": An interview study to understand collaborative practices in interdisciplinary artificial intelligence and healthcare research