activity
20182024
most citedBe Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation

83 citations · 305 across the 33 of their papers we have counts for

collaborators
Showing 2019Show all

9 papers · 1 filter

cs.CV2019★ 3 cited

Light-weight Calibrator: a Separable Component for Unsupervised Domain Adaptation

Shaokai Ye, Kailu Wu, Mu Zhou +6

Existing domain adaptation methods aim at learning features that can be generalized among domains. These methods commonly require to update source classifier to adapt to the target…

cs.CV2019★ 1 cited

Exploring Frequency Domain Interpretation of Convolutional Neural Networks

Zhongfan Jia, Chenglong Bao, Kaisheng Ma

Many existing interpretation methods of convolutional neural networks (CNNs) mainly analyze in spatial domain, yet model interpretability in frequency domain has been rarely studie…

cs.LG2019★ 24 cited

PCONV: The Missing but Desirable Sparsity in DNN Weight Pruning for Real-time Execution on Mobile Devices

Xiaolong Ma, Fu-Ming Guo, Wei Niu +5

Model compression techniques on Deep Neural Network (DNN) have been widely acknowledged as an effective way to achieve acceleration on a variety of platforms, and DNN weight prunin…

cs.LG2019★ 28 cited

Non-Structured DNN Weight Pruning -- Is It Beneficial in Any Platform?

Xiaolong Ma, Sheng Lin, Shaokai Ye +10

Large deep neural network (DNN) models pose the key challenge to energy efficiency due to the significantly higher energy consumption of off-chip DRAM accesses than arithmetic or S…

cs.LG2019★ 3 cited

Brain-inspired reverse adversarial examples

Shaokai Ye, Sia Huat Tan, Kaidi Xu +3

A human does not have to see all elephants to recognize an animal as an elephant. On contrast, current state-of-the-art deep learning approaches heavily depend on the variety of tr…

cs.LG2019★ 14 cited

SCAN: A Scalable Neural Networks Framework Towards Compact and Efficient Models

Linfeng Zhang, Zhanhong Tan, Jiebo Song +3

Remarkable achievements have been attained by deep neural networks in various applications. However, the increasing depth and width of such models also lead to explosive growth in…

cs.LG2019★ 83 cited

Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation

Linfeng Zhang, Jiebo Song, Anni Gao +3

Convolutional neural networks have been widely deployed in various application scenarios. In order to extend the applications' boundaries to some accuracy-crucial domains, research…

cs.LG2019★ 14 cited

Toward Extremely Low Bit and Lossless Accuracy in DNNs with Progressive ADMM

Sheng Lin, Xiaolong Ma, Shaokai Ye +3

Weight quantization is one of the most important techniques of Deep Neural Networks (DNNs) model compression method. A recent work using systematic framework of DNN weight quantiza…

cs.CV2019

Adversarial Robustness vs Model Compression, or Both?

Shaokai Ye, Kaidi Xu, Sijia Liu +6

It is well known that deep neural networks (DNNs) are vulnerable to adversarial attacks, which are implemented by adding crafted perturbations onto benign examples. Min-max robust…