90 citations · 248 across the 15 of their papers we have counts for
Showing 2021Show all
3 papers · 1 filter
cs.CV2021★ 9 cited
On the Integration of Self-Attention and Convolution
Xuran Pan, Chunjiang Ge, Rui Lu +4
Convolution and self-attention are two powerful techniques for representation learning, and they are usually considered as two peer approaches that are distinct from each other. In…
cs.LG2021★ 5 cited
Toward Learning Human-aligned Cross-domain Robust Models by Countering Misaligned Features
Haohan Wang, Zeyi Huang, Hanlin Zhang +2
Machine learning has demonstrated remarkable prediction accuracy over i.i.d data, but the accuracy often drops when tested with data from another distribution. In this paper, we ai…
cs.CV2021★ 19 cited
Not All Images are Worth 16x16 Words: Dynamic Transformers for Efficient Image Recognition
Yulin Wang, Rui Huang, Shiji Song +2
Vision Transformers (ViT) have achieved remarkable success in large-scale image recognition. They split every 2D image into a fixed number of patches, each of which is treated as a…