13 papers
XARP Tools: An Extended Reality Platform for Humans and AI Agents
Arthur Caetano, Radha Kumaran, Kelvin Jou +2
Building XR-AI research prototypes requires navigating two largely separate ecosystems. Mainstream XR development relies on C#/C++ and game engines, while AI development is centere…
MiXR: Harvesting and Recomposing Geometry from Real-World Objects for In-Situ 3D Design
Faraz Faruqi, Demircan Tas, Arthur Caetano +6
Recent developments in 3D generative AI enable users to create bespoke 3D models from text or image prompts. However, these approaches provide limited control over spatial structur…
Grand Challenges around Designing Computers' Control Over Our Bodies
Florian 'Floyd' Mueller, Nadia Bianchi-Berthouze, Misha Sra +21
Advances in emerging technologies, such as on-body mechanical actuators and electrical muscle stimulation, have allowed computers to take control over our bodies. This presents opp…
How Users Perceive Mixed-Initiative AI: Attitudes Toward Assistance in Problem Solving
Yunhao Luo, Arthur Caetano, Avinash Ajit Nargund +2
In mixed-initiative systems, the mode of AI assistance delivery can be as consequential as the assistance itself. We investigated two assistance delivery modes: on-demand help (use…
Understanding Mode Switching in Human-AI Collaboration: Behavioral Insights and Predictive Modeling
Avinash Ajit Nargund, Arthur Caetano, Kevin Yang +6
Human-AI collaboration is typically offered in one of two of user control levels: guidance, where the AI provides suggestions and the human makes the final decision, and delegation…
GraspR: A Computational Model of Spatial User Preferences for Adaptive Grasp UI Design
Arthur Caetano, Yunhao Luo, Adwait Sharma +1
Grasp User Interfaces (grasp UIs) enable dual-tasking in XR by allowing interaction with digital content while holding physical objects. However, current grasp UI design practices…