Adaptive Diffusion Schemes for Heterogeneous Networks

Abstract

In this paper, we deal with distributed estimation problems in diffusion networks with heterogeneous nodes, i.e., nodes that either implement different adaptive rules or differ in some other aspect such as the filter structure or length, or step size. Although such heterogeneous networks have been considered from the first works on diffusion networks, obtaining practical and robust schemes to adaptively adjust the combiners in different scenarios is still an open problem. In this paper, we study a diffusion strategy specially designed and suited to heterogeneous networks. Our approach is based on two key ingredients: 1) the adaptation and combination phases are completely decoupled, so that network nodes keep purely local estimations at all times; and 2) combiners are adapted to minimize estimates of the network mean-square-error. Our scheme is compared with the standard Adapt-then-Combine scheme and theoretically analyzed using energy conservation arguments. Several experiments involving networks with heterogeneous nodes show that the proposed decoupled Adapt-then-Combine approach with adaptive combiners outperforms other state-of-the-art techniques, becoming a competitive approach in these scenarios.

arXiv commentTo appear in in IEEE Transactions on Signal Processing. URL: http://ieeexplore.ieee.org/document/8010454/

References in corpus (9)

• Epidemic outbreaks in complex heterogeneous networks
• Diffusion LMS over Multitask Networks
• Sparse Distributed Learning Based on Diffusion Adaptation
• Performance Limits for Distributed Estimation Over LMS Adaptive Networks
• A Sparsity-Aware Adaptive Algorithm for Distributed Learning
• Distributed Diffusion-Based LMS for Node-Specific Adaptive Parameter Estimation
• Compressive Diffusion Strategies Over Distributed Networks for Reduced Communication Load
• On the Influence of Informed Agents on Learning and Adaptation over Networks
• Diffusion Adaptation Strategies for Distributed Estimation over Gaussian Markov Random Fields

Cited by in corpus (3)

• Distributed Universal Adaptive Networks
• Affine Combination of Diffusion Strategies over Networks
• Diffusion Adaptation Framework for Compressive Sensing Reconstruction