8 papers
egoEMOTION: Egocentric Vision and Physiological Signals for Emotion and Personality Recognition in Real-World Tasks
Matthias Jammot, Björn Braun, Paul Streli +2
Understanding affect is central to anticipating human behavior, yet current egocentric vision benchmarks largely ignore the person's emotional states that shape their decisions and…
Human Motion Capture from Loose and Sparse Inertial Sensors with Garment-aware Diffusion Models
Andela Ilic, Jiaxi Jiang, Paul Streli +2
Motion capture using sparse inertial sensors has shown great promise due to its portability and lack of occlusion issues compared to camera-based tracking. Existing approaches typi…
Continual Human-in-the-Loop Optimization
Yi-Chi Liao, Paul Streli, Zhipeng Li +2
Optimal input settings vary across users due to differences in motor abilities and personal preferences, which are typically addressed by manual tuning or calibration. Although hum…
EgoSim: An Egocentric Multi-view Simulator and Real Dataset for Body-worn Cameras during Motion and Activity
Dominik Hollidt, Paul Streli, Jiaxi Jiang +4
Research on egocentric tasks in computer vision has mostly focused on head-mounted cameras, such as fisheye cameras or embedded cameras inside immersive headsets. We argue that the…
EgoPressure: A Dataset for Hand Pressure and Pose Estimation in Egocentric Vision
Yiming Zhao, Taein Kwon, Paul Streli +2
Touch contact and pressure are essential for understanding how humans interact with and manipulate objects, insights which can significantly benefit applications in mixed reality a…
SympCam: Remote Optical Measurement of Sympathetic Arousal
Björn Braun, Daniel McDuff, Tadas Baltrusaitis +3
Recent work has shown that a person's sympathetic arousal can be estimated from facial videos alone using basic signal processing. This opens up new possibilities in the field of t…