98 citations · 194 across the 9 of their papers we have counts for
9 papers
GlintMarkers: Gaze-Anchored Spatial Perception Using Corneal Reflections
Seungjoo Lee, Vimal Mollyn, Chris Harrison +2
AI assistants on smart glasses need to know what surrounds the user and what the user is looking at. Obtaining this context typically relies on a world-facing camera, raising priva…
HiFiGaze: Improving Eye Tracking Accuracy Using Screen Content Knowledge
Taejun Kim, Vimal Mollyn, Riku Arakawa +1
We present a new and accurate approach for gaze estimation on consumer computing devices. We take advantage of continued strides in the quality of user-facing cameras found in e.g.…
SmartPoser: Arm Pose Estimation with a Smartphone and Smartwatch Using UWB and IMU Data
Nathan DeVrio, Vimal Mollyn, Chris Harrison
The ability to track a user's arm pose could be valuable in a wide range of applications, including fitness, rehabilitation, augmented reality input, life logging, and context-awar…
EclipseTouch: Touch Segmentation on Ad Hoc Surfaces using Worn Infrared Shadow Casting
Vimal Mollyn, Nathan DeVrio, Chris Harrison
The ability to detect touch events on uninstrumented, everyday surfaces has been a long-standing goal for mixed reality systems. Prior work has shown that virtual interfaces bound…
EgoTouch: On-Body Touch Input Using AR/VR Headset Cameras
Vimal Mollyn, Chris Harrison
In augmented and virtual reality (AR/VR) experiences, a user's arms and hands can provide a convenient and tactile surface for touch input. Prior work has shown on-body input to ha…
WheelPoser: Sparse-IMU Based Body Pose Estimation for Wheelchair Users
Yunzhi Li, Vimal Mollyn, Kuang Yuan +1
Despite researchers having extensively studied various ways to track body pose on-the-go, most prior work does not take into account wheelchair users, leading to poor tracking perf…
Vision-Based Hand Gesture Customization from a Single Demonstration
Soroush Shahi, Vimal Mollyn, Cori Tymoszek Park +6
Hand gesture recognition is becoming a more prevalent mode of human-computer interaction, especially as cameras proliferate across everyday devices. Despite continued progress in t…
IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and Earbuds
Vimal Mollyn, Riku Arakawa, Mayank Goel +2
Tracking body pose on-the-go could have powerful uses in fitness, mobile gaming, context-aware virtual assistants, and rehabilitation. However, users are unlikely to buy and wear s…
Eye Gaze Controlled Robotic Arm for Persons with SSMI
Vinay Krishna Sharma, L. R. D. Murthy, KamalPreet Singh Saluja +3
Background: People with severe speech and motor impairment (SSMI) often uses a technique called eye pointing to communicate with outside world. One of their parents, caretakers or…