Learning Multimodal Sensor Fusion with JEPA Representations for Breathing Activity and Pose Recognition

Yunxiang Luo, Constantino Álvarez Casado, Xiaoting Wu +4

Predictive video representations do not by themselves specify how a multimodal system should handle missing sensors. We transfer frozen V-JEPA2 features to a set of heterogeneous s…