619 citations · 1.3k across the 33 of their papers we have counts for
6 papers · 1 filter
ProxylessKD: Direct Knowledge Distillation with Inherited Classifier for Face Recognition
Weidong Shi, Guanghui Ren, Yunpeng Chen +1
Knowledge Distillation (KD) refers to transferring knowledge from a large model to a smaller one, which is widely used to enhance model performance in machine learning. It tries to…
NAS-DIP: Learning Deep Image Prior with Neural Architecture Search
Yun-Chun Chen, Chen Gao, Esther Robb +1
Recent work has shown that the structure of deep convolutional neural networks can be used as a structured image prior for solving various inverse image restoration tasks. Instead…
ConvBERT: Improving BERT with Span-based Dynamic Convolution
Zihang Jiang, Weihao Yu, Daquan Zhou +3
Pre-trained language models like BERT and its variants have recently achieved impressive performance in various natural language understanding tasks. However, BERT heavily relies o…
Rethinking Bottleneck Structure for Efficient Mobile Network Design
Zhou Daquan, Qibin Hou, Yunpeng Chen +2
The inverted residual block is dominating architecture design for mobile networks recently. It changes the classic residual bottleneck by introducing two design rules: learning inv…
Adversarial Domain Adaptation with Prototype-Based Normalized Output Conditioner
Dapeng Hu, Jian Liang, Qibin Hou +2
In this work, we attempt to address unsupervised domain adaptation by devising simple and compact conditional domain adversarial training methods. We first revisit the simple conca…
Highly Efficient Salient Object Detection with 100K Parameters
Shang-Hua Gao, Yong-Qiang Tan, Ming-Ming Cheng +3
Salient object detection models often demand a considerable amount of computation cost to make precise prediction for each pixel, making them hardly applicable on low-power devices…