112 citations · 783 across the 45 of their papers we have counts for
4 papers · 1 filter
Self-slimmed Vision Transformer
Zhuofan Zong, Kunchang Li, Guanglu Song +4
Vision transformers (ViTs) have become the popular structures and outperformed convolutional neural networks (CNNs) on various vision tasks. However, such powerful transformers bri…
INTERN: A New Learning Paradigm Towards General Vision
Jing Shao, Siyu Chen, Yangguang Li +24
Enormous waves of technological innovations over the past several years, marked by the advances in AI technologies, are profoundly reshaping the industry and the society. However,…
UniNet: Unified Architecture Search with Convolution, Transformer, and MLP
Jihao Liu, Hongsheng Li, Guanglu Song +2
Recently, transformer and multi-layer perceptron (MLP) architectures have achieved impressive results on various vision tasks. A few works investigated manually combining those ope…
FNAS: Uncertainty-Aware Fast Neural Architecture Search
Jihao Liu, Ming Zhang, Yangting Sun +4
Reinforcement learning (RL)-based neural architecture search (NAS) generally guarantees better convergence yet suffers from the requirement of huge computational resources compared…