Fully Learnable Group Convolution for Acceleration of Deep Neural Networks

Abstract

Benefitted from its great success on many tasks, deep learning is increasingly used on low-computational-cost devices, e.g. smartphone, embedded devices, etc. To reduce the high computational and memory cost, in this work, we propose a fully learnable group convolution module (FLGC for short) which is quite efficient and can be embedded into any deep neural networks for acceleration. Specifically, our proposed method automatically learns the group structure in the training stage in a fully end-to-end manner, leading to a better structure than the existing pre-defined, two-steps, or iterative strategies. Moreover, our method can be further combined with depthwise separable convolution, resulting in 5 times acceleration than the vanilla Resnet50 on single CPU. An additional advantage is that in our FLGC the number of groups can be set as any value, but not necessarily 2^k as in most existing methods, meaning better tradeoff between accuracy and speed. As evaluated in our experiments, our method achieves better performance than existing learnable group convolution and standard group convolution when using the same number of groups.

arXiv commentAccepted by CVPR 2019

References in corpus (11)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Distilling the Knowledge in a Neural Network
• MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
• Binarized Neural Networks: Training Deep Neural Networks with Weights and Activations Constrained to +1 or -1
• FitNets: Hints for Thin Deep Nets
• Learning Face Representation from Scratch
• Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation
• Compressing Neural Networks with the Hashing Trick
• Robust Face Recognition via Multimodal Deep Face Representation
• Deep Roots: Improving CNN Efficiency with Hierarchical Filter Groups
• ShiftCNN: Generalized Low-Precision Architecture for Inference of Convolutional Neural Networks

Cited by in corpus (2)

• Differentiable Neural Architecture Learning for Efficient Neural Network Design
• Self-grouping Convolutional Neural Networks