23 citations · 143 across the 50 of their papers we have counts for
8 papers · 1 filter
Revisiting Discriminator in GAN Compression: A Generator-discriminator Cooperative Compression Scheme
Shaojie Li, Jie Wu, Xuefeng Xiao +3
Recently, a series of algorithms have been explored for GAN compression, which aims to reduce tremendous computational overhead and memory usages when deploying GANs on resource-co…
Fine-grained Data Distribution Alignment for Post-Training Quantization
Yunshan Zhong, Mingbao Lin, Mengzhao Chen +5
While post-training quantization receives popularity mostly due to its evasion in accessing the original complete training dataset, its poor performance also stems from scarce imag…
Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusion
Mingbao Lin, Bohong Chen, Fei Chao +1
The mainstream approach for filter pruning is usually either to force a hard-coded importance estimation upon a computation-heavy pretrained model to select "important" filters, or…
You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Nature Gradient
Shaokun Zhang, Xiawu Zheng, Chenyi Yang +7
Despite superior performance on various natural language processing tasks, pre-trained models such as BERT are challenged by deploying on resource-constraint devices. Most existing…
Towards Compact CNNs via Collaborative Compression
Yuchao Li, Shaohui Lin, Jianzhuang Liu +7
Channel pruning and tensor decomposition have received extensive attention in convolutional neural network compression. However, these two techniques are traditionally deployed in…
1xN Pattern for Pruning Convolutional Neural Networks
Mingbao Lin, Yuxin Zhang, Yuchao Li +6
Though network pruning receives popularity in reducing the complexity of convolutional neural networks (CNNs), it remains an open issue to concurrently maintain model accuracy as w…
Lottery Jackpots Exist in Pre-trained Models
Yuxin Zhang, Mingbao Lin, Yunshan Zhong +2
Network pruning is an effective approach to reduce network complexity with acceptable performance compromise. Existing studies achieve the sparsity of neural networks via time-cons…
SiMaN: Sign-to-Magnitude Network Binarization
Mingbao Lin, Rongrong Ji, Zihan Xu +4
Binary neural networks (BNNs) have attracted broad research interest due to their efficient storage and computational ability. Nevertheless, a significant challenge of BNNs lies in…