Exploring the Innovation Opportunities for Pre-trained Models

Abstract

Innovators transform the world by understanding where services are successfully meeting customers' needs and then using this knowledge to identify failsafe opportunities for innovation. Pre-trained models have changed the AI innovation landscape, making it faster and easier to create new AI products and services. Understanding where pre-trained models are successful is critical for supporting AI innovation. Unfortunately, the hype cycle surrounding pre-trained models makes it hard to know where AI can really be successful. To address this, we investigated pre-trained model applications developed by HCI researchers as a proxy for commercially successful applications. The research applications demonstrate technical capabilities, address real user needs, and avoid ethical challenges. Using an artifact analysis approach, we categorized capabilities, opportunity domains, data types, and emerging interaction design patterns, uncovering some of the opportunity space for innovation with pre-trained models.

33 pages, 20 figures, 4 tables, DIS

References in corpus (13)

• Pre-trained Models for Natural Language Processing: A Survey
• How Data Scientists Work Together With Domain Experts in Scientific Collaborations: To Find The Right Answer Or To Ask The Right Question?
• PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinement
• Investigating How Practitioners Use Human-AI Guidelines: A Case Study on the People + AI Guidebook
• ChaCha: Leveraging Large Language Models to Prompt Children to Share Their Emotions about Personal Events
• ChatScratch: An AI-Augmented System Toward Autonomous Visual Programming Learning for Children Aged 6-12
• C2Ideas: Supporting Creative Interior Color Design Ideation with Large Language Model
• Selenite: Scaffolding Online Sensemaking with Comprehensive Overviews Elicited from Large Language Models
• How Do UX Practitioners Communicate AI as a Design Material? Artifacts, Conceptions, and Propositions
• Sketching AI Concepts with Capabilities and Examples: AI Innovation in the Intensive Care Unit
• DanceGen: Supporting Choreography Ideation and Prototyping with Generative AI
• Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Design
• Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AI