Addressing UX Practitioners' Challenges in Designing ML Applications: an Interactive Machine Learning Approach

Abstract

UX practitioners face novel challenges when designing user interfaces for machine learning (ML)-enabled applications. Interactive ML paradigms, like AutoML and interactive machine teaching, lower the barrier for non-expert end users to create, understand, and use ML models, but their application to UX practice is largely unstudied. We conducted a task-based design study with 27 UX practitioners where we asked them to propose a proof-of-concept design for a new ML-enabled application. During the task, our participants were given opportunities to create, test, and modify ML models as part of their workflows. Through a qualitative analysis of our post-task interview, we found that direct, interactive experimentation with ML allowed UX practitioners to tie ML capabilities and underlying data to user goals, compose affordances to enhance end-user interactions with ML, and identify ML-related ethical risks and challenges. We discuss our findings in the context of previously established human-AI guidelines. We also identify some limitations of interactive ML in UX processes and propose research-informed machine teaching as a supplement to future design tools alongside interactive ML.

References in corpus (4)

• A Survey on Active Learning and Human-in-the-Loop Deep Learning for Medical Image Analysis
• Towards Automated Machine Learning: Evaluation and Comparison of AutoML Approaches and Tools
• Machine Learning Uncertainty as a Design Material: A Post-Phenomenological Inquiry
• Gesture-aware Interactive Machine Teaching with In-situ Object Annotations

Cited by in corpus (6)

• How Do UX Practitioners Communicate AI as a Design Material? Artifacts, Conceptions, and Propositions
• Take It, Leave It, or Fix It: Measuring Productivity and Trust in Human-AI Collaboration
• Mapping the Design Space of Teachable Social Media Feed Experiences
• Identifying the Barriers to Human-Centered Design in the Workplace: Perspectives from UX Professionals
• Peek into the `White-Box': A Field Study on Bystander Engagement with Urban Robot Uncertainty
• Establishing Heuristics for Improving the Usability of GUI Machine Learning Tools for Novice Users