66 citations · 96 across the 8 of their papers we have counts for
6 papers · 1 filter
Towards Accurate Post-Training Quantization for Vision Transformer
Yifu Ding, Haotong Qin, Qinghua Yan +4
Vision transformer emerges as a potential architecture for vision tasks. However, the intense computation and non-negligible delay hinder its application in the real world. As a wi…
Condensation-Net: Memory-Efficient Network Architecture with Cross-Channel Pooling Layers and Virtual Feature Maps
Tse-Wei Chen, Motoki Yoshinaga, Hongxing Gao +5
"Lightweight convolutional neural networks" is an important research topic in the field of embedded vision. To implement image recognition tasks on a resource-limited hardware plat…
BAMSProd: A Step towards Generalizing the Adaptive Optimization Methods to Deep Binary Model
Junjie Liu, Dongchao Wen, Deyu Wang +4
Recent methods have significantly reduced the performance degradation of Binary Neural Networks (BNNs), but guaranteeing the effective and efficient training of BNNs is an unsolved…
QuantNet: Learning to Quantize by Learning within Fully Differentiable Framework
Junjie Liu, Dongchao Wen, Deyu Wang +4
Despite the achievements of recent binarization methods on reducing the performance degradation of Binary Neural Networks (BNNs), gradient mismatching caused by the Straight-Throug…
DupNet: Towards Very Tiny Quantized CNN with Improved Accuracy for Face Detection
Hongxing Gao, Wei Tao, Dongchao Wen +4
Deploying deep learning based face detectors on edge devices is a challenging task due to the limited computation resources. Even though binarizing the weights of a very tiny netwo…
Knowledge Representing: Efficient, Sparse Representation of Prior Knowledge for Knowledge Distillation
Junjie Liu, Dongchao Wen, Hongxing Gao +4
Despite the recent works on knowledge distillation (KD) have achieved a further improvement through elaborately modeling the decision boundary as the posterior knowledge, their per…