activity
20182022
most citedPredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learning

337 citations · 414 across the 9 of their papers we have counts for

collaborators

9 papers

cs.CV2022

MetaSets: Meta-Learning on Point Sets for Generalizable Representations

Chao Huang, Zhangjie Cao, Yunbo Wang +2

Deep learning techniques for point clouds have achieved strong performance on a range of 3D vision tasks. However, it is costly to annotate large-scale point sets, making it critic…

cs.LG2021★ 1 cited

ModeRNN: Harnessing Spatiotemporal Mode Collapse in Unsupervised Predictive Learning

Zhiyu Yao, Yunbo Wang, Haixu Wu +2

Learning predictive models for unlabeled spatiotemporal data is challenging in part because visual dynamics can be highly entangled in real scenes, making existing approaches prone…

cs.LG2021★ 40 cited

PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learning

Yunbo Wang, Haixu Wu, Jianjin Zhang +4

The predictive learning of spatiotemporal sequences aims to generate future images by learning from the historical context, where the visual dynamics are believed to have modular s…

cs.LG2020★ 7 cited

Unsupervised Transfer Learning for Spatiotemporal Predictive Networks

Zhiyu Yao, Yunbo Wang, Mingsheng Long +1

This paper explores a new research problem of unsupervised transfer learning across multiple spatiotemporal prediction tasks. Unlike most existing transfer learning methods that fo…

cs.CV2019★ 2 cited

VideoDG: Generalizing Temporal Relations in Videos to Novel Domains

Zhiyu Yao, Yunbo Wang, Jianmin Wang +2

This paper introduces video domain generalization where most video classification networks degenerate due to the lack of exposure to the target domains of divergent distributions.…

cs.CV2019★ 4 cited

Spatiotemporal Pyramid Network for Video Action Recognition

Yunbo Wang, Mingsheng Long, Jianmin Wang +1

Two-stream convolutional networks have shown strong performance in video action recognition tasks. The key idea is to learn spatiotemporal features by fusing convolutional networks…

cs.CV2018★ 1 cited

Multi-Task Learning of Generalizable Representations for Video Action Recognition

Zhiyu Yao, Yunbo Wang, Mingsheng Long +3

In classic video action recognition, labels may not contain enough information about the diverse video appearance and dynamics, thus, existing models that are trained under the sta…

cs.LG2018★ 22 cited

Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamics

Yunbo Wang, Jianjin Zhang, Hongyu Zhu +3

Natural spatiotemporal processes can be highly non-stationary in many ways, e.g. the low-level non-stationarity such as spatial correlations or temporal dependencies of local pixel…

cs.LG2018★ 337 cited

PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learning

Yunbo Wang, Zhifeng Gao, Mingsheng Long +2

We present PredRNN++, an improved recurrent network for video predictive learning. In pursuit of a greater spatiotemporal modeling capability, our approach increases the transition…