Diffusion Adaptation over Networks under Imperfect Information Exchange and Non-stationary Data
arXiv:1112.6212 · doi:10.1109/TSP.2012.2192928
Abstract
Adaptive networks rely on in-network and collaborative processing among distributed agents to deliver enhanced performance in estimation and inference tasks. Information is exchanged among the nodes, usually over noisy links. The combination weights that are used by the nodes to fuse information from their neighbors play a critical role in influencing the adaptation and tracking abilities of the network. This paper first investigates the mean-square performance of general adaptive diffusion algorithms in the presence of various sources of imperfect information exchanges, quantization errors, and model non-stationarities. Among other results, the analysis reveals that link noise over the regression data modifies the dynamics of the network evolution in a distinct way, and leads to biased estimates in steady-state. The analysis also reveals how the network mean-square performance is dependent on the combination weights. We use these observations to show how the combination weights can be optimized and adapted. Simulation results illustrate the theoretical findings and match well with theory.
arXiv comment36 pages, 7 figures, to appear in IEEE Transactions on Signal Processing, June 2012
References in corpus (5)
- Gossip Algorithms for Distributed Signal Processing
- Diffusion Adaptation Strategies for Distributed Optimization and Learning over Networks
- Convergence Rate Analysis of Distributed Gossip (Linear Parameter) Estimation: Fundamental Limits and Tradeoffs
- Distributed Consensus Algorithms in Sensor Networks: Link Failures and Channel Noise
- Weight Optimization for Consensus Algorithms with Correlated Switching Topology
Cited by in corpus (29)
- Diffusion Strategies Outperform Consensus Strategies for Distributed Estimation over Adaptive Networks
- Multitask Diffusion Adaptation over Networks
- Diffusion LMS over Multitask Networks
- Performance Limits for Distributed Estimation Over LMS Adaptive Networks
- Compressive Diffusion Strategies Over Distributed Networks for Reduced Communication Load
- Diffusion LMS Strategies in Sensor Networks with Noisy Input Data
- Distributed Detection over Noisy Networks: Large Deviations Analysis
- Estimation of Space-Time Varying Parameters Using a Diffusion LMS Algorithm
- Distributed Decision-Making over Adaptive Networks
- On reducing the communication cost of the diffusion LMS algorithm
- On the Influence of Informed Agents on Learning and Adaptation over Networks
- Quantization for decentralized learning under subspace constraints
- Diffusion Adaptation over Multi-Agent Networks with Wireless Link Impairments
- Multi-hop Diffusion LMS for Energy-constrained Distributed Estimation
- Distributed Adaptive Learning Under Communication Constraints
- A Multitask Diffusion Strategy with Optimized Inter-Cluster Cooperation
- Compressed Regression over Adaptive Networks
- Partial-Diffusion Least Mean-Square Estimation Over Networks Under Noisy Information Exchange
- Asynchronous adaptive networks
- Asynchronous Adaptation and Learning over Networks - Part II: Performance Analysis
- Tackling heavy-tailed noise in distributed estimation: Asymptotic performance and tradeoffs
- On the Learning Behavior of Adaptive Networks - Part II: Performance Analysis
- Formulation and Steady-state Analysis of LMS Adaptive Networks for Distributed Estimation in the Presence of Transmission Errors
- Steady-state Performance of Incremental LMS Strategies For Parameter Estimation Over Fading Wireless Channels
- Maximum Total Correntropy Diffusion Adaptation over Networks with Noisy Links
- Privacy-Preserving Distributed Projection LMS for Linear Multitask Networks
- Impact of network size on the performance of incremental LMS adaptive networks
- Tracking Performance of Incremental LMS Algorithm over Adaptive Distributed Sensor Networks
- An Improved Self-Organizing Diffusion Mobile Adaptive Network for Pursuing a Target