activity
20192022
most citedA Battle of Network Structures: An Empirical Study of CNN, Transformer, and MLP

57 citations · 105 across the 9 of their papers we have counts for

collaborators
Showing 2021Show all

5 papers · 1 filter

cs.CV2021

Learning Tracking Representations via Dual-Branch Fully Transformer Networks

Fei Xie, Chunyu Wang, Guangting Wang +2

We present a Siamese-like Dual-branch network based on solely Transformers for tracking. Given a template and a search image, we divide them into non-overlapping patches and extrac…

cs.CV2021★ 13 cited

Sparse MLP for Image Recognition: Is Self-Attention Really Necessary?

Chuanxin Tang, Yucheng Zhao, Guangting Wang +3

Transformers have sprung up in the field of computer vision. In this work, we explore whether the core self-attention module in Transformer is the key to achieving excellent perfor…

cs.CV2021

Self-Supervised Visual Representations Learning by Contrastive Mask Prediction

Yucheng Zhao, Guangting Wang, Chong Luo +2

Advanced self-supervised visual representation learning methods rely on the instance discrimination (ID) pretext task. We point out that the ID task has an implicit semantic consis…

cs.CV2021★ 57 cited

A Battle of Network Structures: An Empirical Study of CNN, Transformer, and MLP

Yucheng Zhao, Guangting Wang, Chuanxin Tang +3

Convolutional neural networks (CNN) are the dominant deep neural network (DNN) architecture for computer vision. Recently, Transformer and multi-layer perceptron (MLP)-based models…

cs.CV2021★ 1 cited

Unsupervised Visual Representation Learning by Tracking Patches in Video

Guangting Wang, Yizhou Zhou, Chong Luo +3

Inspired by the fact that human eyes continue to develop tracking ability in early and middle childhood, we propose to use tracking as a proxy task for a computer vision system to…