4 papers
Scalable Vision Transformers with Hierarchical Pooling
Zizheng Pan, Bohan Zhuang, Jing Liu +2
The recently proposed Visual image Transformers (ViT) with pure attention have achieved promising performance on image recognition tasks, such as image classification. However, the…
Generative Low-bitwidth Data Free Quantization
Shoukai Xu, Haokun Li, Bohan Zhuang +4
Neural network quantization is an effective way to compress deep models and improve their execution latency and energy efficiency, so that they can be deployed on mobile or embedde…
Discrimination-aware Network Pruning for Deep Model Compression
Jing Liu, Bohan Zhuang, Zhuangwei Zhuang +4
We study network pruning which aims to remove redundant channels/kernels and hence speed up the inference of deep networks. Existing pruning methods either train from scratch with…
Discrimination-aware Channel Pruning for Deep Neural Networks
Zhuangwei Zhuang, Mingkui Tan, Bohan Zhuang +5
Channel pruning is one of the predominant approaches for deep model compression. Existing pruning methods either train from scratch with sparsity constraints on channels, or minimi…