The State of Speech in HCI: Trends, Themes and Challenges
arXiv:1810.06828 · doi:10.1093/iwc/iwz016
Abstract
Speech interfaces are growing in popularity. Through a review of 68 research papers this work maps the trends, themes, findings and methods of empirical research on speech interfaces in HCI. We find that most studies are usability/theory-focused or explore wider system experiences, evaluating Wizard of Oz, prototypes, or developed systems by using self-report questionnaires to measure concepts like usability and user attitudes. A thematic analysis of the research found that speech HCI work focuses on nine key topics: system speech production, modality comparison, user speech production, assistive technology \& accessibility, design insight, experiences with interactive voice response (IVR) systems, using speech technology for development, people's experiences with intelligent personal assistants (IPAs) and how user memory affects speech interface interaction. From these insights we identify gaps and challenges in speech research, notably the need to develop theories of speech interface interaction, grow critical mass in this domain, increase design work, and expand research from single to multiple user interaction contexts so as to reflect current use contexts. We also highlight the need to improve measure reliability, validity and consistency, in the wild deployment and reduce barriers to building fully functional speech interfaces for research.
Version of record & supplementary data pending
Cited by in corpus (19)
- UX Research on Conversational Human-AI Interaction: A Literature Review of the ACM Digital Library
- Unmet Needs and Opportunities for Mobile Translation AI
- Eliciting and Analysing Users' Envisioned Dialogues with Perfect Voice Assistants
- What Do We See in Them? Identifying Dimensions of Partner Models for Speech Interfaces Using a Psycholexical Approach
- Measuring Voice UX Quantitatively: A Rapid Review
- See what I'm saying? Comparing Intelligent Personal Assistant use for Native and Non-Native Language Speakers
- MyMove: Facilitating Older Adults to Collect In-Situ Activity Labels on a Smartwatch with Speech
- Like My Aunt Dorothy: Effects of Conversational Styles on Perceptions, Acceptance and Metaphorical Descriptions of Voice Assistants during Later Adulthood
- Augmented Datasheets for Speech Datasets and Ethical Decision-Making
- Coimagining the Future of Voice Assistants with Cultural Sensitivity
- Qualitative Approaches to Voice UX
- Multitasking with Alexa Multitasking with Alexa: How Using Intelligent Personal Assistants Impacts Language-based Primary Task Performance
- Super Kawaii Vocalics: Amplifying the "Cute" Factor in Computer Voice
- Anonymization of Voices in Spaces for Civic Dialogue: Measuring Impact on Empathy, Trust, and Feeling Heard
- The timing bottleneck: Why timing and overlap are mission-critical for conversational user interfaces, speech recognition and dialogue systems
- Dis/Immersion in Mindfulness Meditation with a Wandering Voice Assistant
- Embrace your incompetence! Designing appropriate CUI communication through an ecological approach
- Cross-Corpora Spoken Language Identification with Domain Diversification and Generalization
- Equanimity in HRI: Applying Calm Technology Principles to Human-Robot Interaction