11 citations · 40 across the 11 of their papers we have counts for
4 papers · 1 filter
OVO: One-shot Vision Transformer Search with Online distillation
Zimian Wei, Hengyue Pan, Xin Niu +1
Pure transformers have shown great potential for vision tasks recently. However, their accuracy in small or medium datasets is not satisfactory. Although some existing methods intr…
DMFormer: Closing the Gap Between CNN and Vision Transformers
Zimian Wei, Hengyue Pan, Lujun Li +4
Vision transformers have shown excellent performance in computer vision tasks. As the computation cost of their self-attention mechanism is expensive, recent works tried to replace…
Prior-Guided One-shot Neural Architecture Search
Peijie Dong, Xin Niu, Lujun Li +5
Neural architecture search methods seek optimal candidates with efficient weight-sharing supernet training. However, recent studies indicate poor ranking consistency about the perf…
Multi-trial Neural Architecture Search with Lottery Tickets
Zimian Wei, Hengyue Pan, Lujun Li +4
Neural architecture search (NAS) has brought significant progress in recent image recognition tasks. Most existing NAS methods apply restricted search spaces, which limits the uppe…