PydMobileNet: Improved Version of MobileNets with Pyramid Depthwise Separable Convolution

Abstract

Convolutional neural networks (CNNs) have shown remarkable performance in various computer vision tasks in recent years. However, the increasing model size has raised challenges in adopting them in real-time applications as well as mobile and embedded vision applications. Many works try to build networks as small as possible while still have acceptable performance. The state-of-the-art architecture is MobileNets. They use Depthwise Separable Convolution (DWConvolution) in place of standard Convolution to reduce the size of networks. This paper describes an improved version of MobileNet, called Pyramid Mobile Network. Instead of using just a $3\times 3$ kernel size for DWConvolution like in MobileNet, the proposed network uses a pyramid kernel size to capture more spatial information. The proposed architecture is evaluated on two highly competitive object recognition benchmark datasets (CIFAR-10, CIFAR-100). The experiments demonstrate that the proposed network achieves better performance compared with MobileNet as well as other state-of-the-art networks. Additionally, it is more flexible in fine-tuning the trade-off between accuracy, latency and model size than MobileNets.

References in corpus (16)

• Distilling the Knowledge in a Neural Network
• MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
• SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
• mixup: Beyond Empirical Risk Minimization
• MobileNetV2: Inverted Residuals and Linear Bottlenecks
• MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
• Wide Residual Networks
• Training Very Deep Networks
• Binarized Neural Networks
• FractalNet: Ultra-Deep Neural Networks without Residuals
• Compressing Neural Networks with the Hashing Trick
• Speeding up Convolutional Neural Networks with Low Rank Expansions
• Channel Pruning for Accelerating Very Deep Neural Networks
• Deep Networks with Stochastic Depth
• Exploring the Regularity of Sparse Structure in Convolutional Neural Networks
• Interleaved Group Convolutions for Deep Neural Networks

Cited by in corpus (1)

• A Survey on Green Deep Learning