The Value-Sensitive Conversational Agent Co-Design Framework
arXiv:2310.11848 · doi:10.1080/10447318.2024.2426737
Abstract
Conversational agents (CAs) are gaining traction in both industry and academia, especially with the advent of generative AI and large language models. As these agents are used more broadly by members of the general public and take on a number of critical use cases and social roles, it becomes important to consider the values embedded in these systems. This consideration includes answering questions such as 'whose values get embedded in these agents?' and 'how do those values manifest in the agents being designed?' Accordingly, the aim of this paper is to present the Value-Sensitive Conversational Agent (VSCA) Framework for enabling the collaborative design (co-design) of value-sensitive CAs with relevant stakeholders. Firstly, requirements for co-designing value-sensitive CAs which were identified in previous works are summarised here. Secondly, the practical framework is presented and discussed, including its operationalisation into a design toolkit. The framework facilitates the co-design of three artefacts that elicit stakeholder values and have a technical utility to CA teams to guide CA implementation, enabling the creation of value-embodied CA prototypes. Finally, an evaluation protocol for the framework is proposed where the effects of the framework and toolkit are explored in a design workshop setting to evaluate both the process followed and the outcomes produced.
23 pages, 8 figures. International Journal of Human Computer Interaction (2024)
References in corpus (24)
- Showing Academic Performance Predictions during Term Planning: Effects on Students' Decisions, Behaviors, and Preferences
- Society-in-the-Loop: Programming the Algorithmic Social Contract
- How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case Study
- How Different Groups Prioritize Ethical Values for Responsible AI
- Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethics
- Investigating How Practitioners Use Human-AI Guidelines: A Case Study on the People + AI Guidebook
- DirectGPT: A Direct Manipulation Interface to Interact with Large Language Models
- AI Ethics Principles in Practice: Perspectives of Designers and Developers
- Walking the Walk of AI Ethics: Organizational Challenges and the Individualization of Risk among Ethics Entrepreneurs
- Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practice
- The illusion of artificial inclusion
- Farsight: Fostering Responsible AI Awareness During AI Application Prototyping
- `It is currently hodgepodge'': Examining AI/ML Practitioners' Challenges during Co-production of Responsible AI Values
- Towards Measuring the Representation of Subjective Global Opinions in Language Models
- Sociotechnical Safety Evaluation of Generative AI Systems
- A Scoping Study of Evaluation Practices for Responsible AI Tools: Steps Towards Effectiveness Evaluations
- Artificial Concepts of Artificial Intelligence: Institutional Compliance and Resistance in AI Startups
- What are you optimizing for? Aligning Recommender Systems with Human Values
- Enabling Value Sensitive AI Systems through Participatory Design Fictions
- From Fitting Participation to Forging Relationships: The Art of Participatory ML
- Next Steps for Human-Centered Generative AI: A Technical Perspective
- Assessing LLMs for Moral Value Pluralism
- Unpacking the Ethical Value Alignment in Big Models
- CIVICS: Building a Dataset for Examining Culturally-Informed Values in Large Language Models