An Overview of Multi-Processor Approximate Message Passing
arXiv:1702.03049
Abstract
Approximate message passing (AMP) is an algorithmic framework for solving linear inverse problems from noisy measurements, with exciting applications such as reconstructing images, audio, hyper spectral images, and various other signals, including those acquired in compressive signal acquisiton systems. The growing prevalence of big data systems has increased interest in large-scale problems, which may involve huge measurement matrices that are unsuitable for conventional computing systems. To address the challenge of large-scale processing, multiprocessor (MP) versions of AMP have been developed. We provide an overview of two such MP-AMP variants. In row-MP-AMP, each computing node stores a subset of the rows of the matrix and processes corresponding measurements. In column- MP-AMP, each node stores a subset of columns, and is solely responsible for reconstructing a portion of the signal. We will discuss pros and cons of both approaches, summarize recent research results for each, and explain when each one may be a viable approach. Aspects that are highlighted include some recent results on state evolution for both MP-AMP algorithms, and the use of data compression to reduce communication in the MP network.
References in corpus (20)
- Message Passing Algorithms for Compressed Sensing
- Expectation-Maximization Gaussian-Mixture Approximate Message Passing
- Bilinear Generalized Approximate Message Passing
- Compressive Imaging using Approximate Message Passing and a Markov-Tree Prior
- Distributed Basis Pursuit
- Adaptive Damping and Mean Removal for the Generalized Approximate Message Passing Algorithm
- Capacity-achieving Sparse Superposition Codes via Approximate Message Passing Decoding
- Phase transitions and sample complexity in Bayes-optimal matrix factorization
- Distributed Compressed Sensing For Static and Time-Varying Networks
- Compressive Hyperspectral Imaging via Approximate Message Passing
- Compressive Imaging via Approximate Message Passing with Image Denoising
- Hybrid Approximate Message Passing
- Sparse Estimation with the Swept Approximated Message-Passing Algorithm
- Approximate Message Passing Algorithm with Universal Denoising and Gaussian Mixture Learning
- DECOrrelated feature space partitioning for distributed sparse regression
- Multi-Processor Approximate Message Passing Using Lossy Compression
- Inference for Generalized Linear Models via Alternating Directions and Bethe Free Energy Minimization
- Performance Regions in Compressed Sensing from Noisy Measurements
- Statistical Physics and Information Theory Perspectives on Linear Inverse Problems
- Multiprocessor Approximate Message Passing with Column-Wise Partitioning