"Mango Mango, How to Let The Lettuce Dry Without A Spinner?": Exploring User Perceptions of Using An LLM-Based Conversational Assistant Toward Cooking Partner
arXiv:2310.05853 · doi:10.1145/3757442
Abstract
The rapid advancement of Large Language Models (LLMs) has created numerous potentials for integration with conversational assistants (CAs) assisting people in their daily tasks, particularly due to their extensive flexibility. However, users' real-world experiences interacting with these assistants remain unexplored. In this research, we chose cooking, a complex daily task, as a scenario to explore people's successful and unsatisfactory experiences while receiving assistance from an LLM-based CA, Mango Mango. We discovered that participants value the system's ability to offer customized instructions based on context, provide extensive information beyond the recipe, and assist them in dynamic task planning. However, users expect the system to be more adaptive to oral conversation and provide more suggestive responses to keep them actively involved. Recognizing that users began treating our LLM-CA as a personal assistant or even a partner rather than just a recipe-reading tool, we propose five design considerations for future development.
To appear at CSCW 2025
References in corpus (13)
- Survey of Hallucination in Natural Language Generation
- Training language models to follow instructions with human feedback
- Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities
- Co-Writing with Opinionated Language Models Affects Users' Views
- Supporting Qualitative Analysis with Large Language Models: Combining Codebook with GPT-3 for Deductive Coding
- Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data
- Tell Me About Yourself: Using an AI-Powered Chatbot to Conduct Conversational Surveys with Open-ended Questions
- StoryBuddy: A Human-AI Collaborative Chatbot for Parent-Child Interactive Storytelling with Flexible Parental Involvement
- Eliciting and Analysing Users' Envisioned Dialogues with Perfect Voice Assistants
- Evorus: A Crowd-powered Conversational Assistant Built to Automate Itself Over Time
- Inform the uninformed: Improving Online Informed Consent Reading with an AI-Powered Chatbot
- A Recipe for Success? Exploring Strategies for Improving Non-Visual Access to Cooking Instructions