32 citations · 74 across the 16 of their papers we have counts for
4 papers · 1 filter
Learning Long-Term Spatial-Temporal Graphs for Active Speaker Detection
Kyle Min, Sourya Roy, Subarna Tripathi +2
Active speaker detection (ASD) in videos with multiple speakers is a challenging task as it requires learning effective audiovisual features and spatial-temporal correlations over…
Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videos
Shaowei Liu, Subarna Tripathi, Somdeb Majumdar +1
We propose to forecast future hand-object interactions given an egocentric video. Instead of predicting action labels or pixels, we directly predict the hand motion trajectory and…
Learning Spatial-Temporal Graphs for Active Speaker Detection
Sourya Roy, Kyle Min, Subarna Tripathi +2
We address the problem of active speaker detection through a new framework, called SPELL, that learns long-range multimodal graphs to encode the inter-modal relationship between au…
Exploiting Long-Term Dependencies for Generating Dynamic Scene Graphs
Shengyu Feng, Subarna Tripathi, Hesham Mostafa +2
Dynamic scene graph generation from a video is challenging due to the temporal dynamics of the scene and the inherent temporal fluctuations of predictions. We hypothesize that capt…