Learning and Management for Internet-of-Things: Accounting for Adaptivity and Scalability
arXiv:1810.11613
Abstract
Internet-of-Things (IoT) envisions an intelligent infrastructure of networked smart devices offering task-specific monitoring and control services. The unique features of IoT include extreme heterogeneity, massive number of devices, and unpredictable dynamics partially due to human interaction. These call for foundational innovations in network design and management. Ideally, it should allow efficient adaptation to changing environments, and low-cost implementation scalable to massive number of devices, subject to stringent latency constraints. To this end, the overarching goal of this paper is to outline a unified framework for online learning and management policies in IoT through joint advances in communication, networking, learning, and optimization. From the network architecture vantage point, the unified framework leverages a promising fog architecture that enables smart devices to have proximity access to cloud functionalities at the network edge, along the cloud-to-things continuum. From the algorithmic perspective, key innovations target online approaches adaptive to different degrees of nonstationarity in IoT dynamics, and their scalable model-free implementation under limited feedback that motivates blind or bandit approaches. The proposed framework aspires to offer a stepping stone that leads to systematic designs and analysis of task-specific learning and management schemes for IoT, along with a host of new research directions to build on.
Submitted on June 15 to Proceeding of IEEE Special Issue on Adaptive and Scalable Communication Networks
References in corpus (7)
- Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments
- SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives
- Fully Decentralized Multi-Agent Reinforcement Learning with Networked Agents
- Optimal and Scalable Caching for 5G Using Reinforcement Learning of Space-time Popularities
- Bandit Convex Optimization for Scalable and Dynamic IoT Management
- Online Convex Optimization with Stochastic Constraints
- Online Optimization with Predictions and Switching Costs: Fast Algorithms and the Fundamental Limit