A Multitask Diffusion Strategy with Optimized Inter-Cluster Cooperation
arXiv:1703.01888 · doi:10.1109/JSTSP.2017.2679339
Abstract
We consider a multitask estimation problem where nodes in a network are divided into several connected clusters, with each cluster performing a least-mean-squares estimation of a different random parameter vector. Inspired by the adapt-then-combine diffusion strategy, we propose a multitask diffusion strategy whose mean stability can be ensured whenever individual nodes are stable in the mean, regardless of the inter-cluster cooperation weights. In addition, the proposed strategy is able to achieve an asymptotically unbiased estimation, when the parameters have same mean. We also develop an inter-cluster cooperation weights selection scheme that allows each node in the network to locally optimize its inter-cluster cooperation weights. Numerical results demonstrate that our approach leads to a lower average steady-state network mean-square deviation, compared with using weights selected by various other commonly adopted methods in the literature.
30 pages, 8 figures, submitted to IEEE Journal of Selected Topics in Signal Processing
References in corpus (9)
- Multitask Diffusion Adaptation over Networks
- Diffusion LMS over Multitask Networks
- Distributed Clustering and Learning Over Networks
- Adaptive Penalty-Based Distributed Stochastic Convex Optimization
- Distributed Diffusion-Based LMS for Node-Specific Adaptive Parameter Estimation
- Compressive Diffusion Strategies Over Distributed Networks for Reduced Communication Load
- Robust Decentralized Detection and Social Learning in Tandem Networks
- Distributed Local Linear Parameter Estimation using Gaussian SPAWN
- Multi-hop Diffusion LMS for Energy-constrained Distributed Estimation