3 papers
cs.RO2024
RoCap: A Robotic Data Collection Pipeline for the Pose Estimation of Appearance-Changing Objects
Jiahao Nick Li, Toby Chong, Zhongyi Zhou +4
Object pose estimation plays a vital role in mixed-reality interactions when users manipulate tangible objects as controllers. Traditional vision-based object pose estimation metho…
cs.HC2024
OmniActions: Predicting Digital Actions in Response to Real-World Multimodal Sensory Inputs with LLMs
Jiahao Nick Li, Yan Xu, Tovi Grossman +2
The progression to "Pervasive Augmented Reality" envisions easy access to multimodal information continuously. However, in many everyday scenarios, users are occupied physically, c…
cs.HC2024
Human I/O: Towards a Unified Approach to Detecting Situational Impairments
Xingyu Bruce Liu, Jiahao Nick Li, David Kim +2
Situationally Induced Impairments and Disabilities (SIIDs) can significantly hinder user experience in contexts such as poor lighting, noise, and multi-tasking. While prior researc…