19 citations · 84 across the 19 of their papers we have counts for
5 papers · 1 filter
OVO: One-shot Vision Transformer Search with Online distillation
Zimian Wei, Hengyue Pan, Xin Niu +1
Pure transformers have shown great potential for vision tasks recently. However, their accuracy in small or medium datasets is not satisfactory. Although some existing methods intr…
DMFormer: Closing the Gap Between CNN and Vision Transformers
Zimian Wei, Hengyue Pan, Lujun Li +4
Vision transformers have shown excellent performance in computer vision tasks. As the computation cost of their self-attention mechanism is expensive, recent works tried to replace…
Prior-Guided One-shot Neural Architecture Search
Peijie Dong, Xin Niu, Lujun Li +5
Neural architecture search methods seek optimal candidates with efficient weight-sharing supernet training. However, recent studies indicate poor ranking consistency about the perf…
Learning Convolutional Neural Networks in the Frequency Domain
Hengyue Pan, Yixin Chen, Xin Niu +2
Convolutional neural network (CNN) has achieved impressive success in computer vision during the past few decades. The image convolution operation helps CNNs to get good performanc…
Multi-trial Neural Architecture Search with Lottery Tickets
Zimian Wei, Hengyue Pan, Lujun Li +4
Neural architecture search (NAS) has brought significant progress in recent image recognition tasks. Most existing NAS methods apply restricted search spaces, which limits the uppe…