70 citations · 219 across the 14 of their papers we have counts for
6 papers · 1 filter
Sparse MLP for Image Recognition: Is Self-Attention Really Necessary?
Chuanxin Tang, Yucheng Zhao, Guangting Wang +3
Transformers have sprung up in the field of computer vision. In this work, we explore whether the core self-attention module in Transformer is the key to achieving excellent perfor…
Self-Supervised Visual Representations Learning by Contrastive Mask Prediction
Yucheng Zhao, Guangting Wang, Chong Luo +2
Advanced self-supervised visual representation learning methods rely on the instance discrimination (ID) pretext task. We point out that the ID task has an implicit semantic consis…
A Battle of Network Structures: An Empirical Study of CNN, Transformer, and MLP
Yucheng Zhao, Guangting Wang, Chuanxin Tang +3
Convolutional neural networks (CNN) are the dominant deep neural network (DNN) architecture for computer vision. Recently, Transformer and multi-layer perceptron (MLP)-based models…
Unsupervised Visual Representation Learning by Tracking Patches in Video
Guangting Wang, Yizhou Zhou, Chong Luo +3
Inspired by the fact that human eyes continue to develop tracking ability in early and middle childhood, we propose to use tracking as a proxy task for a computer vision system to…
General-Purpose Speech Representation Learning through a Self-Supervised Multi-Granularity Framework
Yucheng Zhao, Dacheng Yin, Chong Luo +4
This paper presents a self-supervised learning framework, named MGF, for general-purpose speech representation learning. In the design of MGF, speech hierarchy is taken into consid…
VAE^2: Preventing Posterior Collapse of Variational Video Predictions in the Wild
Yizhou Zhou, Chong Luo, Xiaoyan Sun +2
Predicting future frames of video sequences is challenging due to the complex and stochastic nature of the problem. Video prediction methods based on variational auto-encoders (VAE…