On reducing the communication cost of the diffusion LMS algorithm
arXiv:1711.11423 · doi:10.1109/TSIPN.2018.2863218
Abstract
The rise of digital and mobile communications has recently made the world more connected and networked, resulting in an unprecedented volume of data flowing between sources, data centers, or processes. While these data may be processed in a centralized manner, it is often more suitable to consider distributed strategies such as diffusion as they are scalable and can handle large amounts of data by distributing tasks over networked agents. Although it is relatively simple to implement diffusion strategies over a cluster, it appears to be challenging to deploy them in an ad-hoc network with limited energy budget for communication. In this paper, we introduce a diffusion LMS strategy that significantly reduces communication costs without compromising the performance. Then, we analyze the proposed algorithm in the mean and mean-square sense. Next, we conduct numerical experiments to confirm the theoretical findings. Finally, we perform large scale simulations to test the algorithm efficiency in a scenario where energy is limited.
References in corpus (14)
- Diffusion Adaptation Strategies for Distributed Optimization and Learning over Networks
- Distributed Learning in Wireless Sensor Networks
- Multitask Diffusion Adaptation over Networks
- Diffusion LMS over Multitask Networks
- Sparse Distributed Learning Based on Diffusion Adaptation
- Diffusion Adaptation over Networks under Imperfect Information Exchange and Non-stationary Data
- Distributed Pareto Optimization via Diffusion Strategies
- A Sparsity-Aware Adaptive Algorithm for Distributed Learning
- Compressive Diffusion Strategies Over Distributed Networks for Reduced Communication Load
- Proximal Multitask Learning over Networks with Sparsity-inducing Coregularization
- Multitask diffusion adaptation over networks with common latent representations
- Coordinate-Descent Diffusion Learning by Networked Agents
- Partial-Diffusion Least Mean-Square Estimation Over Networks Under Noisy Information Exchange
- Analysis of a Reduced-Communication Diffusion LMS Algorithm