State-of-the-art Techniques in Deep Edge Intelligence

Abstract

The potential held by the gargantuan volumes of data being generated across networks worldwide has been truly unlocked by machine learning techniques and more recently Deep Learning. The advantages offered by the latter have seen it rapidly becoming a framework of choice for various applications. However, the centralization of computational resources and the need for data aggregation have long been limiting factors in the democratization of Deep Learning applications. Edge Computing is an emerging paradigm that aims to utilize the hitherto untapped processing resources available at the network periphery. Edge Intelligence (EI) has quickly emerged as a powerful alternative to enable learning using the concepts of Edge Computing. Deep Learning-based Edge Intelligence or Deep Edge Intelligence (DEI) lies in this rapidly evolving domain. In this article, we provide an overview of the major constraints in operationalizing DEI. The major research avenues in DEI have been consolidated under Federated Learning, Distributed Computation, Compression Schemes and Conditional Computation. We also present some of the prevalent challenges and highlight prospective research avenues.

arXiv comment13 pages, 5 figures, 1 table

References in corpus (22)

• A Survey on Deep Learning in Medical Image Analysis
• Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
• Communication-Efficient Learning of Deep Networks from Decentralized Data
• Towards A Rigorous Science of Interpretable Machine Learning
• Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
• AMC: AutoML for Model Compression and Acceleration on Mobile Devices
• Edge Intelligence: The Confluence of Edge Computing and Artificial Intelligence
• In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning
• Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training
• How To Backdoor Federated Learning
• Communication-Efficient Federated Deep Learning with Asynchronous Model Update and Temporally Weighted Aggregation
• Personalized Federated Learning: A Meta-Learning Approach
• Local SGD Converges Fast and Communicates Little
• Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication
• Edge Intelligence: Architectures, Challenges, and Applications
• Learn To Pay Attention
• GossipGraD: Scalable Deep Learning using Gossip Communication based Asynchronous Gradient Descent
• Fixing the train-test resolution discrepancy: FixEfficientNet
• SquishedNets: Squishing SqueezeNet further for edge device scenarios via deep evolutionary synthesis
• Real-Time Edge Intelligence in the Making: A Collaborative Learning Framework via Federated Meta-Learning
• Collaborative Execution of Deep Neural Networks on Internet of Things Devices
• CacheNet: A Model Caching Framework for Deep Learning Inference on the Edge