On Capacity Optimality of OAMP: Beyond IID Sensing Matrices and Gaussian Signaling
arXiv:2108.08503
Abstract
This paper investigates a large unitarily invariant system (LUIS) involving a unitarily invariant sensing matrix, an arbitrarily fixed signal distribution, and forward error control (FEC) coding. A universal Gram-Schmidt orthogonalization is considered for constructing orthogonal approximate message passing (OAMP), enabling its applicability to a wide range of prototypes without the constraint of differentiability. We develop two single-input-single-output variational transfer functions for OAMP with Lipschitz continuous local estimators, facilitating an analysis of achievable rates. Furthermore, when the state evolution of OAMP has a unique fixed point, we reveal that OAMP can achieve the constrained capacity predicted by the replica method of LUIS based on matched FEC coding, regardless of the signal distribution. The replica method is rigorously validated for LUIS with Gaussian signaling and certain sub-classes of LUIS with arbitrary signal distributions. Several area properties are established based on the variational transfer functions of OAMP. Meanwhile, we present a replica constrained capacity-achieving coding principle for LUIS. This principle serves as the basis for optimizing irregular low-density parity-check (LDPC) codes specifically tailored for binary signaling in our simulation results. The performance of OAMP with these optimized codes exhibits a remarkable improvement over the unoptimized codes and even surpasses the well-known Turbo-LMMSE algorithm. For quadrature phase-shift keying (QPSK) modulation, we observe bit error rates (BER) performance near the replica constrained capacity across diverse channel conditions.
arXiv commentDouble columns, 17 pages, 9 figures
References in corpus (11)
- Message Passing Algorithms for Compressed Sensing
- Expectation Propagation for approximate Bayesian inference
- Massive Connectivity with Massive MIMO-Part I: Device Activity Detection and Channel Estimation
- Turbo Compressed Sensing with Partial DFT Sensing Matrix
- Massive Connectivity with Massive MIMO-Part II: Achievable Rate Characterization
- Adaptive Damping and Mean Removal for the Generalized Approximate Message Passing Algorithm
- Capacity-Achieving MIMO-NOMA: Iterative LMMSE Detection
- Analysis of CDMA systems that are characterized by eigenvalue spectrum
- On the Performance of Turbo Signal Recovery with Partial DFT Sensing Matrices
- Deep Learning Based on Orthogonal Approximate Message Passing for CP-Free OFDM
- Fourth Moment Theorems for complex Gaussian approximation