Sketching AI Concepts with Capabilities and Examples: AI Innovation in the Intensive Care Unit

Abstract

Advances in artificial intelligence (AI) have enabled unprecedented capabilities, yet innovation teams struggle when envisioning AI concepts. Data science teams think of innovations users do not want, while domain experts think of innovations that cannot be built. A lack of effective ideation seems to be a breakdown point. How might multidisciplinary teams identify buildable and desirable use cases? This paper presents a first hand account of ideating AI concepts to improve critical care medicine. As a team of data scientists, clinicians, and HCI researchers, we conducted a series of design workshops to explore more effective approaches to AI concept ideation and problem formulation. We detail our process, the challenges we encountered, and practices and artifacts that proved effective. We discuss the research implications for improved collaboration and stakeholder engagement, and discuss the role HCI might play in reducing the high failure rate experienced in AI innovation.

to appear at CHI 2024

References in corpus (21)

• To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-making
• Improving fairness in machine learning systems: What do industry practitioners need?
• Questioning the AI: Informing Design Practices for Explainable AI User Experiences
• Fairness and Accountability Design Needs for Algorithmic Support in High-Stakes Public Sector Decision-Making
• Unremarkable AI: Fitting Intelligent Decision Support into Critical, Clinical Decision-Making Processes
• The Fallacy of AI Functionality
• Problem Formulation and Fairness
• Designing AI for Trust and Collaboration in Time-Constrained Medical Decisions: A Sociotechnical Lens
• How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case Study
• Machine Learning Uncertainty as a Design Material: A Post-Phenomenological Inquiry
• Investigating How Practitioners Use Human-AI Guidelines: A Case Study on the People + AI Guidebook
• A Systematic Review and Thematic Analysis of Community-Collaborative Approaches to Computing Research
• Understanding Frontline Workers' and Unhoused Individuals' Perspectives on AI Used in Homeless Services
• Imagining new futures beyond predictive systems in child welfare: A qualitative study with impacted stakeholders
• Deliberating with AI: Improving Decision-Making for the Future through Participatory AI Design and Stakeholder Deliberation
• Soliciting Stakeholders' Fairness Notions in Child Maltreatment Predictive Systems
• `It is currently hodgepodge'': Examining AI/ML Practitioners' Challenges during Co-production of Responsible AI Values
• How Do UX Practitioners Communicate AI as a Design Material? Artifacts, Conceptions, and Propositions
• Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Design
• Ground Truth Or Dare: Factors Affecting The Creation Of Medical Datasets For Training AI
• Investigating Why Clinicians Deviate from Standards of Care: Liberating Patients from Mechanical Ventilation in the ICU

Cited by in corpus (6)

• Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for Radiology
• ASHABot: An LLM-Powered Chatbot to Support the Informational Needs of Community Health Workers
• Investigating Why Clinicians Deviate from Standards of Care: Liberating Patients from Mechanical Ventilation in the ICU
• Making the Right Thing: Bridging HCI and Responsible AI in Early-Stage AI Concept Selection
• Exploring the Innovation Opportunities for Pre-trained Models
• Tempo: Helping Data Scientists and Domain Experts Collaboratively Specify Predictive Modeling Tasks