11 papers
Cooking beyond Frames: A Stereo Event Camera Dataset in the Kitchen
Chengming Feng, Hesam Araghi, Liming Zheng +4
Event cameras, also known as neuromorphic cameras, have gained significant attention in recent years due to their high temporal resolution, high dynamic range, and low power consum…
ReViV: Reconstructing the Viewer and the View in 4D from Monocular Egocentric Video
Xiaozhong Lyu, Gen Li, Zhiyin Qian +3
Egocentric devices, such as wearable front-facing cameras, provide a unique perspective for capturing the continuous interaction between a human viewer and the surrounding environm…
Fine-grained Human Motion Understanding with Language Models
Thomas Markhorst, Zhi-Yi Lin, Jouh Yeong Chew +2
In this work, we propose \methodname, an LLM-based model for fine-grained human motion understanding that represents motion as a sequence of skeletal poses with explicit timestamps…
AmbientEye: A Dataset for Pupil Segmentation under Natural Ambient Infrared Illumination
Mingyu Han, Hyunyoung Han, Nitheekulawatn Thommakoon +4
Eye tracking is essential for smart glasses, as it provides insight into user attention for ambient intelligence applications. However, most existing eye-tracking systems rely on a…
PolySLGen: Online Multimodal Speaking-Listening Reaction Generation in Polyadic Interaction
Zhi-Yi Lin, Thomas Markhorst, Jouh Yeong Chew +1
Human-like multimodal reaction generation is essential for natural group interactions between humans and embodied AI. However, existing approaches are limited to single-modality or…
MuPPet: Multi-person 2D-to-3D Pose Lifting
Thomas Markhorst, Zhi-Yi Lin, Jouh Yeong Chew +2
Multi-person social interactions are inherently built on coherence and relationships among all individuals within the group, making multi-person localization and body pose estimati…