139 citations · 934 across the 48 of their papers we have counts for
79 papers
cosFormer: Rethinking Softmax in Attention
Zhen Qin, Weixuan Sun, Hui Deng +6
Transformer has shown great successes in natural language processing, computer vision, and audio processing. As one of its core components, the softmax attention helps to capture l…
GLiT: Neural Architecture Search for Global and Local Image Transformer
Boyu Chen, Peixia Li, Chuming Li +6
We introduce the first Neural Architecture Search (NAS) method to find a better transformer architecture for image recognition. Recently, transformers without CNN-based backbones a…
BN-NAS: Neural Architecture Search with Batch Normalization
Boyu Chen, Peixia Li, Baopu Li +5
We present BN-NAS, neural architecture search with Batch Normalization (BN-NAS), to accelerate neural architecture search (NAS). BN-NAS can significantly reduce the time required b…
Geometry Uncertainty Projection Network for Monocular 3D Object Detection
Yan Lu, Xinzhu Ma, Lei Yang +5
Geometry Projection is a powerful depth estimation method in monocular 3D object detection. It estimates depth dependent on heights, which introduces mathematical priors into the d…
PSViT: Better Vision Transformer via Token Pooling and Attention Sharing
Boyu Chen, Peixia Li, Baopu Li +6
In this paper, we observe two levels of redundancies when applying vision transformers (ViT) for image recognition. First, fixing the number of tokens through the whole network pro…
GAIA: A Transfer Learning System of Object Detection that Fits Your Needs
Xingyuan Bu, Junran Peng, Junjie Yan +2
Transfer learning with pre-training on large-scale datasets has played an increasingly significant role in computer vision and natural language processing recently. However, as the…