Asynchronous Adaptation and Learning over Networks --- Part I: Modeling and Stability Analysis
arXiv:1312.5434
Abstract
In this work and the supporting Parts II [2] and III [3], we provide a rather detailed analysis of the stability and performance of asynchronous strategies for solving distributed optimization and adaptation problems over networks. We examine asynchronous networks that are subject to fairly general sources of uncertainties, such as changing topologies, random link failures, random data arrival times, and agents turning on and off randomly. Under this model, agents in the network may stop updating their solutions or may stop sending or receiving information in a random manner and without coordination with other agents. We establish in Part I conditions on the first and second-order moments of the relevant parameter distributions to ensure mean-square stable behavior. We derive in Part II expressions that reveal how the various parameters of the asynchronous behavior influence network performance. We compare in Part III the performance of asynchronous networks to the performance of both centralized solutions and synchronous networks. One notable conclusion is that the mean-square-error performance of asynchronous networks shows a degradation only of the order of , where is a small step-size parameter, while the convergence rate remains largely unaltered. The results provide a solid justification for the remarkable resilience of cooperative networks in the face of random failures at multiple levels: agents, links, data arrivals, and topology.
arXiv comment40 pages, 6 figures
References in corpus (11)
- Diffusion Adaptation Strategies for Distributed Optimization and Learning over Networks
- Diffusion Strategies Outperform Consensus Strategies for Distributed Estimation over Adaptive Networks
- The Complex Gradient Operator and the CR-Calculus
- Sensor Networks with Random Links: Topology Design for Distributed Consensus
- Convergence Rate Analysis of Distributed Gossip (Linear Parameter) Estimation: Fundamental Limits and Tradeoffs
- Likelihood Consensus and Its Application to Distributed Particle Filtering
- Distributed Pareto Optimization via Diffusion Strategies
- Distributed Consensus Algorithms in Sensor Networks: Link Failures and Channel Noise
- Weight Optimization for Consensus Algorithms with Correlated Switching Topology
- On Distributed Online Classification in the Midst of Concept Drifts
- On the Learning Behavior of Adaptive Networks - Part I: Transient Analysis