Exploring Challenges and Opportunities to Support Designers in Learning to Co-create with AI-based Manufacturing Design Tools

Abstract

AI-based design tools are proliferating in professional software to assist engineering and industrial designers in complex manufacturing and design tasks. These tools take on more agentic roles than traditional computer-aided design tools and are often portrayed as "co-creators." Yet, working effectively with such systems requires different skills than working with complex CAD tools alone. To date, we know little about how engineering designers learn to work with AI-based design tools. In this study, we observed trained designers as they learned to work with two AI-based tools on a realistic design task. We find that designers face many challenges in learning to effectively co-create with current systems, including challenges in understanding and adjusting AI outputs and in communicating their design goals. Based on our findings, we highlight several design opportunities to better support designer-AI co-creation.

arXiv comment20 pages, 6 figures, to be published in Proceedings of the ACM 2023 CHI Conference on Human Factors in Computing Systems (CHI '23)

References in corpus (4)

• Zero-Shot Text-to-Image Generation
• High-Resolution Image Synthesis with Latent Diffusion Models
• It Takes Two to Tango: Towards Theory of AI's Mind
• Characterizing Human Explanation Strategies to Inform the Design of Explainable AI for Building Damage Assessment

Cited by in corpus (13)

• The Metacognitive Demands and Opportunities of Generative AI
• Design Principles for Generative AI Applications
• Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation
• "It's like a rubber duck that talks back": Understanding Generative AI-Assisted Data Analysis Workflows through a Participatory Prompting Study
• Exploring Collaboration Patterns and Strategies in Human-AI Co-creation through the Lens of Agency: A Scoping Review of the Top-tier HCI Literature
• Jigsaw: Supporting Designers to Prototype Multimodal Applications by Chaining AI Foundation Models
• DesignFromX: Empowering Consumer-Driven Design Space Exploration through Feature Composition of Referenced Products
• Intent Tagging: Exploring Micro-Prompting Interactions for Supporting Granular Human-GenAI Co-Creation Workflows
• Exploring the Potential of Metacognitive Support Agents for Human-AI Co-Creation
• What Does Success Look Like? Catalyzing Meeting Intentionality with AI-Assisted Prospective Reflection
• AI That Helps Us Help Each Other: A Proactive System for Scaffolding Mentor-Novice Collaboration in Entrepreneurship Coaching
• Exploring Visual Prompts: Refining Images with Scribbles and Annotations in Generative AI Image Tools
• No Pixel Left Behind: Filling Gaps in Anime Colorization