Compressive Diffusion Strategies Over Distributed Networks for Reduced Communication Load

Abstract

We study the compressive diffusion strategies over distributed networks based on the diffusion implementation and adaptive extraction of the information from the compressed diffusion data. We demonstrate that one can achieve a comparable performance with the full information exchange configurations, even if the diffused information is compressed into a scalar or a single bit. To this end, we provide a complete performance analysis for the compressive diffusion strategies. We analyze the transient, steady-state and tracking performance of the configurations in which the diffused data is compressed into a scalar or a single-bit. We propose a new adaptive combination method improving the convergence performance of the compressive diffusion strategies further. In the new method, we introduce one more freedom-of-dimension in the combination matrix and adapt it by using the conventional mixture approach in order to enhance the convergence performance for any possible combination rule used for the full diffusion configuration. We demonstrate that our theoretical analysis closely follow the ensemble averaged results in our simulations. We provide numerical examples showing the improved convergence performance with the new adaptive combination method.

Submitted to IEEE Transactions on Signal Processing

Cited by in corpus (10)

• On reducing the communication cost of the diffusion LMS algorithm
• Adaptive Diffusion Schemes for Heterogeneous Networks
• Diffusion leaky LMS algorithm: analysis and implementation
• A Multitask Diffusion Strategy with Optimized Inter-Cluster Cooperation
• Distributed Universal Adaptive Networks
• Partial-Diffusion Least Mean-Square Estimation Over Networks Under Noisy Information Exchange
• Analysis of a Reduced-Communication Diffusion LMS Algorithm
• On the Asymptotic Bias of the Diffusion-Based Distributed Pareto Optimization
• Team-Optimal Distributed MMSE Estimation in General and Tree Networks
• Distributed Compressed Estimation for Wireless Sensor Networks Based on Compressive Sensing