3 papers
cs.CV2025
GateFusion: Hierarchical Gated Cross-Modal Fusion for Active Speaker Detection
Yu Wang, Juhyung Ha, Frangil M. Ramirez +2
Active Speaker Detection (ASD) aims to identify who is currently speaking in each frame of a video. Most state-of-the-art approaches rely on late fusion to combine visual and audio…
cs.CV2025
EgoVIS@CVPR: PAIR-Net: Enhancing Egocentric Speaker Detection via Pretrained Audio-Visual Fusion and Alignment Loss
Yu Wang, Juhyung Ha, David J. Crandall
Active speaker detection (ASD) in egocentric videos presents unique challenges due to unstable viewpoints, motion blur, and off-screen speech sources - conditions under which tradi…
stat.ML2025
MoCA: Multi-modal Cross-masked Autoencoder for Time Series in Digital Health
Howon Ryu, Yuliang Chen, Yacun Wang +5
Wearable devices enable continuous multi-modal physiological and behavioral monitoring, yet analysis of these data streams faces fundamental challenges including the lack of gold-s…