GraspR: A Computational Model of Spatial User Preferences for Adaptive Grasp UI Design

Abstract

Grasp User Interfaces (grasp UIs) enable dual-tasking in XR by allowing interaction with digital content while holding physical objects. However, current grasp UI design practices face a fundamental challenge: existing approaches either capture user preferences through labor-intensive elicitation studies that are difficult to scale or rely on biomechanical models that overlook subjective factors. We introduce GraspR, the first computational model that predicts user preferences for single-finger microgestures in grasp UIs. Our data-driven approach combines the scalability of computational methods with human preference modeling, trained on 1,520 preferences collected via a two-alternative forced choice paradigm across eight participants and four frequently used grasp variations. We demonstrate GraspR's effectiveness through a working prototype that dynamically adjusts interface layouts across four everyday tasks. We release both the dataset and code to support future research in adaptive grasp UIs.

References in corpus (5)

• Embodied Hands: Modeling and Capturing Hands and Bodies Together
• NICER: A New and Improved Consumed Endurance and Recovery Metric to Quantify Muscle Fatigue of Mid-Air Interactions
• Toward Optimized VR/AR Ergonomics: Modeling and Predicting User Neck Muscle Contraction
• AlphaPIG: The Nicest Way to Prolong Interactive Gestures in Extended Reality
• GraV: Grasp Volume Data for the Design of One-Handed XR Interfaces