5 papers
GlintMarkers: Spatial Perception on XR Eyewear using Corneal Reflections
Seungjoo Lee, Vimal Mollyn, Chris Harrison +2
We present GlintMarkers, the first system to perform gaze-driven spatial perception using the inward-facing cameras on XR eyewear. Our key observation is that the cornea acts as a…
HiFiGaze: Improving Eye Tracking Accuracy Using Screen Content Knowledge
Taejun Kim, Vimal Mollyn, Riku Arakawa +1
We present a new and accurate approach for gaze estimation on consumer computing devices. We take advantage of continued strides in the quality of user-facing cameras found in e.g.…
SmartPoser: Arm Pose Estimation with a Smartphone and Smartwatch Using UWB and IMU Data
Nathan DeVrio, Vimal Mollyn, Chris Harrison
The ability to track a user's arm pose could be valuable in a wide range of applications, including fitness, rehabilitation, augmented reality input, life logging, and context-awar…
EclipseTouch: Touch Segmentation on Ad Hoc Surfaces using Worn Infrared Shadow Casting
Vimal Mollyn, Nathan DeVrio, Chris Harrison
The ability to detect touch events on uninstrumented, everyday surfaces has been a long-standing goal for mixed reality systems. Prior work has shown that virtual interfaces bound…
EgoTouch: On-Body Touch Input Using AR/VR Headset Cameras
Vimal Mollyn, Chris Harrison
In augmented and virtual reality (AR/VR) experiences, a user's arms and hands can provide a convenient and tactile surface for touch input. Prior work has shown on-body input to ha…