How Do UX Practitioners Communicate AI as a Design Material? Artifacts, Conceptions, and Propositions

Abstract

UX practitioners (UXPs) face novel challenges when working with and communicating artificial intelligence (AI) as a design material. We explore how UXPs communicate AI concepts when given hands-on experience training and experimenting with AI models. To do so, we conducted a task-based design study with 27 UXPs in which they prototyped and created a design presentation for a AI-enabled interface while having access to a simple AI model training tool. Through analyzing UXPs' design presentations and post-activity interviews, we found that although UXPs struggled to clearly communicate some AI concepts, tinkering with AI broadened common ground when communicating with technical stakeholders. UXPs also identified key risks and benefits of AI in their designs, and proposed concrete next steps for both UX and AI work. We conclude with a sensitizing concept and recommendations for design and AI tools to enhance multi-stakeholder communication and collaboration when crafting human-centered AI experiences.

References in corpus (7)

• Improving fairness in machine learning systems: What do industry practitioners need?
• Towards Automated Machine Learning: Evaluation and Comparison of AutoML Approaches and Tools
• Trust in Data Science: Collaboration, Translation, and Accountability in Corporate Data Science Projects
• Machine Learning Uncertainty as a Design Material: A Post-Phenomenological Inquiry
• Understanding Collaborative Practices and Tools of Professional UX Practitioners in Software Organizations
• Gesture-aware Interactive Machine Teaching with In-situ Object Annotations
• Addressing UX Practitioners' Challenges in Designing ML Applications: an Interactive Machine Learning Approach

Cited by in corpus (11)

• Design Principles for Generative AI Applications
• Multimodal Healthcare AI: Identifying and Designing Clinically Relevant Vision-Language Applications for Radiology
• C2Ideas: Supporting Creative Interior Color Design Ideation with Large Language Model
• From Prompt Engineering to Prompt Craft
• Sketching AI Concepts with Capabilities and Examples: AI Innovation in the Intensive Care Unit
• The GenUI Study: Exploring the Design of Generative UI Tools to Support UX Practitioners and Beyond
• Identifying the Barriers to Human-Centered Design in the Workplace: Perspectives from UX Professionals
• Exploring the Innovation Opportunities for Pre-trained Models
• An Interaction Design Toolkit for Physical Task Guidance with Artificial Intelligence and Mixed Reality
• Exploring Visual Prompts: Refining Images with Scribbles and Annotations in Generative AI Image Tools
• Establishing Heuristics for Improving the Usability of GUI Machine Learning Tools for Novice Users