Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligence

Abstract

Artificial intelligence (AI) has witnessed a substantial breakthrough in a variety of Internet of Things (IoT) applications and services, spanning from recommendation systems to robotics control and military surveillance. This is driven by the easier access to sensory data and the enormous scale of pervasive/ubiquitous devices that generate zettabytes (ZB) of real-time data streams. Designing accurate models using such data streams, to predict future insights and revolutionize the decision-taking process, inaugurates pervasive systems as a worthy paradigm for a better quality-of-life. The confluence of pervasive computing and artificial intelligence, Pervasive AI, expanded the role of ubiquitous IoT systems from mainly data collection to executing distributed computations with a promising alternative to centralized learning, presenting various challenges. In this context, a wise cooperation and resource scheduling should be envisaged among IoT devices (e.g., smartphones, smart vehicles) and infrastructure (e.g. edge nodes, and base stations) to avoid communication and computation overheads and ensure maximum performance. In this paper, we conduct a comprehensive survey of the recent techniques developed to overcome these resource challenges in pervasive AI systems. Specifically, we first present an overview of the pervasive computing, its architecture, and its intersection with artificial intelligence. We then review the background, applications and performance metrics of AI, particularly Deep Learning (DL) and online learning, running in a ubiquitous system. Next, we provide a deep literature review of communication-efficient techniques, from both algorithmic and system perspectives, of distributed inference, training and online learning tasks across the combination of IoT devices, edge devices and cloud servers. Finally, we discuss our future vision and research challenges.

Survey paper accepted in IEEE Communications Surveys & Tutorials

References in corpus (25)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
• Generative Adversarial Networks
• A Brief Survey of Deep Reinforcement Learning
• Federated Learning for Internet of Things: A Comprehensive Survey
• Deep Learning with Limited Numerical Precision
• Cost-Effective Active Learning for Deep Image Classification
• Federated Learning for 6G Communications: Challenges, Methods, and Future Directions
• Edge Computing For Smart Health: Context-aware Approaches, Opportunities, and Challenges
• Federated Learning in the Sky: Aerial-Ground Air Quality Sensing Framework with UAV Swarms
• Differential Privacy-enabled Federated Learning for Sensitive Health Data
• JALAD: Joint Accuracy- and Latency-Aware Deep Structure Decoupling for Edge-Cloud Execution
• Analysis and Optimal Edge Assignment For Hierarchical Federated Learning on Non-IID Data
• Distributed Training of Deep Learning Models: A Taxonomic Perspective
• FLaaS: Federated Learning as a Service
• R-MADDPG for Partially Observable Environments and Limited Communication
• Distributed CNN Inference on Resource-Constrained UAVs for Surveillance Systems: Design and Optimization
• A simple local 3-approximation algorithm for vertex cover
• RL-DistPrivacy: Privacy-Aware Distributed Deep Inference for low latency IoT systems
• Multi-Agent Multi-Armed Bandits with Limited Communication
• Federated Multi-armed Bandits with Personalization
• Distributed Non-Stochastic Experts
• Combining Federated and Active Learning for Communication-efficient Distributed Failure Prediction in Aeronautics
• Federated Self-supervised Learning for Heterogeneous Clients
• Security of Distributed Machine Learning: A Game-Theoretic Approach to Design Secure DSVM

Cited by in corpus (10)

• Empowering Edge Intelligence: A Comprehensive Survey on On-Device AI Models
• Towards Ubiquitous Semantic Metaverse: Challenges, Approaches, and Opportunities
• A Tutorial on 5G Positioning
• Deep Reinforcement Learning for Trajectory Path Planning and Distributed Inference in Resource-Constrained UAV Swarms
• Optimal Resource Management for Hierarchical Federated Learning over HetNets with Wireless Energy Transfer
• Zero-touch realization of Pervasive Artificial Intelligence-as-a-service in 6G networks
• RL-DistPrivacy: Privacy-Aware Distributed Deep Inference for low latency IoT systems
• A Blockchain-based Reliable Federated Meta-learning for Metaverse: A Dual Game Framework
• Fundamentals of Physical AI
• A Predictive Neural Network Architecture for Early Detection of Low-Rate Cyberattacks