Deep Learning Towards Mobile Applications

Abstract

Recent years have witnessed an explosive growth of mobile devices. Mobile devices are permeating every aspect of our daily lives. With the increasing usage of mobile devices and intelligent applications, there is a soaring demand for mobile applications with machine learning services. Inspired by the tremendous success achieved by deep learning in many machine learning tasks, it becomes a natural trend to push deep learning towards mobile applications. However, there exist many challenges to realize deep learning in mobile applications, including the contradiction between the miniature nature of mobile devices and the resource requirement of deep neural networks, the privacy and security concerns about individuals' data, and so on. To resolve these challenges, during the past few years, great leaps have been made in this area. In this paper, we provide an overview of the current challenges and representative achievements about pushing deep learning on mobile devices from three aspects: training with mobile data, efficient inference on mobile devices, and applications of mobile deep learning. The former two aspects cover the primary tasks of deep learning. Then, we go through our two recent applications that apply the data collected by mobile devices to inferring mood disturbance and user identification. Finally, we conclude this paper with the discussion of the future of this area.

arXiv commentConference version accepted by ICDCS'18

References in corpus (14)

• Distilling the Knowledge in a Neural Network
• MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
• Deep Learning with Differential Privacy
• Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation
• Deep Learning with Limited Numerical Precision
• Compressing Deep Convolutional Networks using Vector Quantization
• A Survey of Model Compression and Acceleration for Deep Neural Networks
• Learning Differentially Private Recurrent Language Models
• Deep Models Under the GAN: Information Leakage from Collaborative Deep Learning
• DeepMood: Modeling Mobile Phone Typing Dynamics for Mood Detection
• Distributed Deep Neural Networks over the Cloud, the Edge and End Devices
• An exploration of parameter redundancy in deep networks with circulant projections
• PrivyNet: A Flexible Framework for Privacy-Preserving Deep Neural Network Training
• Not Just Privacy: Improving Performance of Private Deep Learning in Mobile Cloud

Cited by in corpus (4)

• Edge Intelligence: Architectures, Challenges, and Applications
• An Orchestrated Empirical Study on Deep Learning Frameworks and Platforms
• MDLdroid: a ChainSGD-reduce Approach to Mobile Deep Learning for Personal Mobile Sensing
• Effective, Fast, and Memory-Efficient Compressed Multi-function Convolutional Neural Networks for More Accurate Medical Image Classification