26 citations · 63 across the 8 of their papers we have counts for
Showing 2021Show all
3 papers · 1 filter
cs.CL2021
EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation
Chenhe Dong, Guangrun Wang, Hang Xu +3
Pre-trained language models have shown remarkable results on various NLP tasks. Nevertheless, due to their bulky size and slow inference speed, it is hard to deploy them on edge de…
cs.CV2021★ 2 cited
Pi-NAS: Improving Neural Architecture Search by Reducing Supernet Training Consistency Shift
Jiefeng Peng, Jiqi Zhang, Changlin Li +3
Recently proposed neural architecture search (NAS) methods co-train billions of architectures in a supernet and estimate their potential accuracy using the network weights detached…
cs.CV2021★ 1 cited
BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search
Changlin Li, Tao Tang, Guangrun Wang +4
A myriad of recent breakthroughs in hand-crafted neural architectures for visual recognition have highlighted the urgent need to explore hybrid architectures consisting of diversif…