349 citations · 2.5k across the 74 of their papers we have counts for
7 papers · 1 filter
StNet: Local and Global Spatial-Temporal Modeling for Action Recognition
Dongliang He, Zhichao Zhou, Chuang Gan +5
Despite the success of deep learning for static image understanding, it remains unclear what are the most effective network architectures for the spatial-temporal modeling in video…
Weakly Supervised Dense Event Captioning in Videos
Xuguang Duan, Wenbing Huang, Chuang Gan +3
Dense event captioning aims to detect and describe all events of interest contained in a video. Despite the advanced development in this area, existing methods tackle this task by…
TSM: Temporal Shift Module for Efficient Video Understanding
Ji Lin, Chuang Gan, Song Han
The explosive growth in video streaming gives rise to challenges on performing video understanding at high accuracy and low computation cost. Conventional 2D CNNs are computational…
Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understanding
Kexin Yi, Jiajun Wu, Chuang Gan +3
We marry two powerful ideas: deep representation learning for visual recognition and language understanding, and symbolic program execution for reasoning. Our neural-symbolic visua…
Controllable Image-to-Video Translation: A Case Study on Facial Expression Generation
Lijie Fan, Wenbing Huang, Chuang Gan +2
The recent advances in deep learning have made it possible to generate photo-realistic images by using neural networks and even to extrapolate video frames from an input video clip…
End-to-End Learning of Motion Representation for Video Understanding
Lijie Fan, Wenbing Huang, Chuang Gan +3
Despite the recent success of end-to-end learned representations, hand-crafted optical flow features are still widely used in video analysis tasks. To fill this gap, we propose TVN…
The Sound of Pixels
Hang Zhao, Chuang Gan, Andrew Rouditchenko +3
We introduce PixelPlayer, a system that, by leveraging large amounts of unlabeled videos, learns to locate image regions which produce sounds and separate the input sounds into a s…