Iterative Low-Rank Approximation for CNN Compression
arXiv:1803.08995
Abstract
Deep convolutional neural networks contain tens of millions of parameters, making them impossible to work efficiently on embedded devices. We propose iterative approach of applying low-rank approximation to compress deep convolutional neural networks. Since classification and object detection are the most favored tasks for embedded devices, we demonstrate the effectiveness of our approach by compressing AlexNet, VGG-16, YOLOv2 and Tiny YOLO networks. Our results show the superiority of the proposed method compared to non-repetitive ones. We demonstrate higher compression ratio providing less accuracy loss.
arXiv commentUpdated paper: arXiv:1903.09973
References in corpus (9)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
- Improving neural networks by preventing co-adaptation of feature detectors
- Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation
- CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning
- Fixed Point Quantization of Deep Convolutional Networks
- Convolutional Neural Networks using Logarithmic Data Representation
- Speeding-up Convolutional Neural Networks Using Fine-tuned CP-Decomposition
- Subdominant Dense Clusters Allow for Simple Learning and High Computational Performance in Neural Networks with Discrete Synapses