Discovering the Sweet Spot of Human-Computer Configurations: A Case Study in Information Extraction
arXiv:1909.07065 · doi:10.1145/3359297
Abstract
Interactive intelligent systems, i.e., interactive systems that employ AI technologies, are currently present in many parts of our social, public and political life. An issue reoccurring often in the development of these systems is the question regarding the level of appropriate human and computer contributions. Engineers and designers lack a way of systematically defining and delimiting possible options for designing such systems in terms of levels of automation. In this paper, we propose, apply and reflect on a method for human-computer configuration design. It supports the systematic investigation of the design space for developing an interactive intelligent system. We illustrate our method with a use case in the context of collaborative ideation. Here, we developed a tool for information extraction from idea content. A challenge was to find the right level of algorithmic support, whereby the quality of the information extraction should be as high as possible, but, at the same time, the human effort should be low. Such contradicting goals are often an issue in system development; thus, our method proposed helped us to conceptualize and explore the design space. Based on a critical reflection on our method application, we want to offer a complementary perspective to the value-centered design of interactive intelligent systems. Our overarching goal is to contribute to the design of so-called hybrid systems where humans and computers are partners.
Accepted Version of the Paper published at CSCW 2019
References in corpus (1)
Cited by in corpus (8)
- "It Felt Like Having a Second Mind": Investigating Human-AI Co-creativity in Prewriting with Large Language Models
- Designing Word Filter Tools for Creator-led Comment Moderation
- SoK: Content Moderation in Social Media, from Guidelines to Enforcement, and Research to Practice
- Collaboration with Conversational AI Assistants for UX Evaluation: Questions and How to Ask them (Voice vs. Text)
- Increasing the Speed and Accuracy of Data LabelingThrough an AI Assisted Interface
- CoPrompt: Supporting Prompt Sharing and Referring in Collaborative Natural Language Programming
- To Classify is to Interpret: Building Taxonomies from Heterogeneous Data through Human-AI Collaboration
- Supporting Serendipity: Opportunities and Challenges for Human-AI Collaboration in Qualitative Analysis