Performance Limits for Distributed Estimation Over LMS Adaptive Networks
arXiv:1206.3728 · doi:10.1109/TSP.2012.2204985
Abstract
In this work we analyze the mean-square performance of different strategies for distributed estimation over least-mean-squares (LMS) adaptive networks. The results highlight some useful properties for distributed adaptation in comparison to fusion-based centralized solutions. The analysis establishes that, by optimizing over the combination weights, diffusion strategies can deliver lower excess-mean-square-error than centralized solutions employing traditional block or incremental LMS strategies. We first study in some detail the situation involving combinations of two adaptive agents and then extend the results to generic N-node ad-hoc networks. In the later case, we establish that, for sufficiently small step-sizes, diffusion strategies can outperform centralized block or incremental LMS strategies by optimizing over left-stochastic combination weighting matrices. The results suggest more efficient ways for organizing and processing data at fusion centers, and present useful adaptive strategies that are able to enhance performance when implemented in a distributed manner.
39 pages, 7 figures, to appear in IEEE Transactions on Signal Processing, 2012
References in corpus (1)
Cited by in corpus (30)
- Distributed Pareto Optimization via Diffusion Strategies
- Distributed Clustering and Learning Over Networks
- Adaptive Penalty-Based Distributed Stochastic Convex Optimization
- Compressive Diffusion Strategies Over Distributed Networks for Reduced Communication Load
- Diffusion LMS Strategies in Sensor Networks with Noisy Input Data
- Distributed Adaptive Networks: A Graphical Evolutionary Game-Theoretic View
- Diffusion-Based Adaptive Distributed Detection: Steady-State Performance in the Slow Adaptation Regime
- Stability and Performance Limits of Adaptive Primal-Dual Networks
- Estimation of Space-Time Varying Parameters Using a Diffusion LMS Algorithm
- Adaptive Diffusion Schemes for Heterogeneous Networks
- Diff-DAC: Distributed Actor-Critic for Average Multitask Deep Reinforcement Learning
- On Distributed Online Classification in the Midst of Concept Drifts
- Information-Sharing over Adaptive Networks with Self-interested Agents
- Centralized Adaptation for Parameter Estimation over Wireless Sensor Networks
- A Multitask Diffusion Strategy with Optimized Inter-Cluster Cooperation
- On the Learning Behavior of Adaptive Networks - Part I: Transient Analysis
- Distributed dictionary learning over a sensor network
- Asynchronous adaptive networks
- Diffusion-KLMS Algorithm and its Performance Analysis for Non-Linear Distributed Networks
- Fully Distributed Actor-Critic Architecture for Multitask Deep Reinforcement Learning
- Stochastic Subgradient Algorithms for Strongly Convex Optimization over Distributed Networks
- Formulation and Steady-state Analysis of LMS Adaptive Networks for Distributed Estimation in the Presence of Transmission Errors
- On the Learning Behavior of Adaptive Networks - Part II: Performance Analysis
- Distributed Estimation for Adaptive Networks Based on Serial-Inspired Diffusion
- Steady-state Performance of Incremental LMS Strategies For Parameter Estimation Over Fading Wireless Channels
- Dynamic Topology Adaptation Based on Adaptive Link Selection Algorithms for Distributed Estimation
- Proceedings of the second "international Traveling Workshop on Interactions between Sparse models and Technology" (iTWIST'14)
- Study of Distributed Conjugate Gradient Strategies for Distributed Estimation Over Sensor Networks
- A Class of Diffusion Algorithms with Logarithmic Cost over Adaptive Sparse Volterra Network
- Distributed Policy Evaluation Under Multiple Behavior Strategies