activity
20172023
most citedVATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text

339 citations · 679 across the 15 of their papers we have counts for

collaborators
Showing 2021Show all

6 papers · 1 filter

cs.CV2021★ 2 cited

Contextualized Spatio-Temporal Contrastive Learning with Self-Supervision

Liangzhe Yuan, Rui Qian, Yin Cui +5

Modern self-supervised learning algorithms typically enforce persistency of instance representations across views. While being very effective on learning holistic image and video r…

cs.CV2021★ 15 cited

Revisiting 3D ResNets for Video Recognition

Xianzhi Du, Yeqing Li, Yin Cui +3

A recent work from Bello shows that training and scaling strategies may be more significant than model architectures for visual recognition. This short note studies effective train…

cs.CV2021★ 3 cited

Motion-aware Contrastive Video Representation Learning via Foreground-background Merging

Shuangrui Ding, Maomao Li, Tianyu Yang +5

In light of the success of contrastive learning in the image domain, current self-supervised video representation learning methods usually employ contrastive loss to facilitate vid…

cs.CV2021

Enhancing Self-supervised Video Representation Learning via Multi-level Feature Optimization

Rui Qian, Yuxi Li, Huabin Liu +5

The crux of self-supervised video representation learning is to build general features from unlabeled videos. However, most recent works have mainly focused on high-level semantics…

cs.CV2021★ 86 cited

TA2N: Two-Stage Action Alignment Network for Few-shot Action Recognition

Shuyuan Li, Huabin Liu, Rui Qian +5

Few-shot action recognition aims to recognize novel action classes (query) using just a few samples (support). The majority of current approaches follow the metric learning paradig…

cs.CV2021★ 339 cited

VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text

Hassan Akbari, Liangzhe Yuan, Rui Qian +4

We present a framework for learning multimodal representations from unlabeled data using convolution-free Transformer architectures. Specifically, our Video-Audio-Text Transformer…