Adapting User Interfaces with Model-based Reinforcement Learning

Abstract

Adapting an interface requires taking into account both the positive and negative effects that changes may have on the user. A carelessly picked adaptation may impose high costs to the user -- for example, due to surprise or relearning effort -- or "trap" the process to a suboptimal design immaturely. However, effects on users are hard to predict as they depend on factors that are latent and evolve over the course of interaction. We propose a novel approach for adaptive user interfaces that yields a conservative adaptation policy: It finds beneficial changes when there are such and avoids changes when there are none. Our model-based reinforcement learning method plans sequences of adaptations and consults predictive HCI models to estimate their effects. We present empirical and simulation results from the case of adaptive menus, showing that the method outperforms both a non-adaptive and a frequency-based policy.

arXiv comment13 pages, 10 figures, ACM CHI 2021 Full Paper

References in corpus (3)

• Optimal Sensor Position for a Computer Mouse
• Modeling Human Visual Search Performance on Realistic Webpages Using Analytical and Deep Learning Methods
• SAM: A Modular Framework for Self-Adapting Web Menus

Cited by in corpus (11)

• Rediscovering Affordance: A Reinforcement Learning Perspective
• Adaptive user interfaces in systems targeting chronic disease: a systematic literature review
• Reinforcement Learning-Based Framework for the Intelligent Adaptation of User Interfaces
• Beyond Games: A Systematic Review of Neural Monte Carlo Tree Search Applications
• Designing Adaptive User Interfaces for mHealth Applications Targeting Chronic Disease: A User-Centered Approach
• Towards Massive Interaction with Generalist Robotics: A Systematic Review of XR-enabled Remote Human-Robot Interaction Systems
• Generating User Experience Based on Personas with AI Assistants
• Adaptive 3D UI Placement in Mixed Reality Using Deep Reinforcement Learning
• Interacting with Masculinities: A Scoping Review
• Composable Prompting Workspaces for Creative Writing: Exploration and Iteration Using Dynamic Widgets
• Towards Adaptive External Communication in Autonomous Vehicles: A Conceptual Design Framework