Threshold Saturation via Spatial Coupling: Why Convolutional LDPC Ensembles Perform so well over the BEC
arXiv:1001.1826 · doi:10.1109/TIT.2010.2095072
Abstract
Convolutional LDPC ensembles, introduced by Felstrom and Zigangirov, have excellent thresholds and these thresholds are rapidly increasing as a function of the average degree. Several variations on the basic theme have been proposed to date, all of which share the good performance characteristics of convolutional LDPC ensembles. We describe the fundamental mechanism which explains why "convolutional-like" or "spatially coupled" codes perform so well. In essence, the spatial coupling of the individual code structure has the effect of increasing the belief-propagation (BP) threshold of the new ensemble to its maximum possible value, namely the maximum-a-posteriori (MAP) threshold of the underlying ensemble. For this reason we call this phenomenon "threshold saturation." This gives an entirely new way of approaching capacity. One significant advantage of such a construction is that one can create capacity-approaching ensembles with an error correcting radius which is increasing in the blocklength. Our proof makes use of the area theorem of the BP-EXIT curve and the connection between the MAP and BP threshold recently pointed out by Measson, Montanari, Richardson, and Urbanke. Although we prove the connection between the MAP and the BP threshold only for a very specific ensemble and only for the binary erasure channel, empirically a threshold saturation phenomenon occurs for a wide class of ensembles and channels. More generally, we conjecture that for a large range of graphical systems a similar saturation of the "dynamical" threshold occurs once individual components are coupled sufficiently strongly. This might give rise to improved algorithms as well as to new techniques for analysis.
29 pages, 11 figures, To appear in Special Issue of the IEEE Transactions on Information Theory, Facets of Coding Theory: from Algorithms to Networks
References in corpus (2)
Cited by in corpus (67)
- Statistical physics of inference: Thresholds and algorithms
- Coded Slotted ALOHA: A Graph-Based Method for Uncoordinated Multiple Access
- Spatially Coupled LDPC Codes Constructed from Protographs
- SPARCs for Unsourced Random Access
- Approximate message-passing decoder and capacity-achieving sparse superposition codes
- Threshold Saturation for Spatially-Coupled LDPC and LDGM Codes on BMS Channels
- Spatially Coupled Sparse Codes on Graphs - Theory and Practice
- Searching for Voltage Graph-Based LDPC Tailbiting Codes with Large Girth
- The Mutual Information in Random Linear Estimation
- Spatially Coupled Turbo-Like Codes
- A Simple Proof of Maxwell Saturation for Coupled Scalar Recursions
- Approximate message-passing with spatially coupled structured operators, with applications to compressed sensing and sparse superposition codes
- Mutual Information and Optimality of Approximate Message-Passing in Random Linear Estimation
- A Scaling Law to Predict the Finite-Length Performance of Spatially-Coupled LDPC Codes
- Spatially-Coupled Random Access on Graphs
- Hierarchical and High-Girth QC LDPC Codes
- Performance Improvement of Iterative Multiuser Detection for Large Sparsely-Spread CDMA Systems by Spatial Coupling
- Capacity-achieving Spatially Coupled Sparse Superposition Codes with AMP Decoding
- Reed-Muller Codes on BMS Channels Achieve Vanishing Bit-Error Probability for All Rates Below Capacity
- Construction of Near-Capacity Protograph LDPC Code Sequences with Block-Error Thresholds
- Distributed satellite information networks: Architecture, enabling technologies, and trends
- Threshold Saturation in Spatially Coupled Constraint Satisfaction Problems
- A Phenomenological Study on Threshold Improvement via Spatial Coupling
- Threshold Saturation for Nonbinary SC-LDPC Codes on the Binary Erasure Channel
- Analysis and Optimization of Tail-Biting Spatially Coupled Protograph LDPC Codes for BICM-ID Systems
- Multilevel Coding Schemes for Compute-and-Forward with Flexible Decoding
- Glassy nature of the hard phase in inference problems
- Spatially-Coupled MacKay-Neal Codes and Hsu-Anastasopoulos Codes
- Optimized Bit Mappings for Spatially Coupled LDPC Codes over Parallel Binary Erasure Channels
- A New Class of Multiple-rate Codes Based on Block Markov Superposition Transmission
- Belief Propagation with Quantum Messages for Quantum-Enhanced Classical Communications
- On the Minimum Distance of Generalized Spatially Coupled LDPC Codes
- One and Two Bit Message Passing for SC-LDPC Codes with Higher-Order Modulation
- Optimal group testing
- The Effect of Coupling Memory and Block Length on Spatially Coupled Serially Concatenated Codes
- Terminated and Tailbiting Spatially-Coupled Codes with Optimized Bit Mappings for Spectrally Efficient Fiber-Optical Systems
- Improving soft FEC performance for higher-order modulations via optimized bit channel mappings
- New Codes on Graphs Constructed by Connecting Spatially Coupled Chains
- Threshold Analysis of Non-Binary Spatially-Coupled LDPC Codes with Windowed Decoding
- Spatially Coupled Generalized LDPC Codes: Asymptotic Analysis and Finite Length Scaling
- Tree-Structure Expectation Propagation for LDPC Decoding over the BEC
- Design and Performance of Rate-compatible Non-Binary LDPC Convolutional Codes
- Duality of channels and codes
- Spatially Coupled Codes and Optical Fiber Communications: An Ideal Match?
- Nonbinary Spatially-Coupled LDPC Codes on the Binary Erasure Channel
- Statistical mechanical analysis of sparse linear regression as a variable selection problem
- Mitigating errors in logical qubits
- Continuous Transmission of Spatially-Coupled LDPC Code Chains
- Near-Optimal Coding for Many-user Multiple Access Channels
- On Doped SC-LDPC Codes for Streaming
- Finite-Length Scaling of Spatially Coupled LDPC Codes Under Window Decoding Over the BEC
- Finite-Length Analysis of Spatially-Coupled Regular LDPC Ensembles on Burst-Erasure Channels
- Secure Computation-and-Forward with Linear Codes
- Dynamics and termination cost of spatially coupled mean-field models
- Bayes-Optimal Estimation in Generalized Linear Models via Spatial Coupling
- Spatially-Coupled QLDPC Codes
- Constructing Linear Encoders with Good Spectra
- Quantum Error Correction near the Coding Theoretical Bound
- Low-Density Parity-Check Codes and Spatial Coupling for Quantitative Group Testing
- Joint Compute and Forward for the Two Way Relay Channel with Spatially Coupled LDPC Codes
- Spatially Coupled LDPC Codes for Decode-and-Forward in Erasure Relay Channel
- The Stability of Low-Density Parity-Check Codes and Some of Its Consequences
- Replication-based Inference Algorithms for Hard Computational Problems
- Time-Invariant LDPC Convolutional Codes
- A Refined Scaling Law for Spatially Coupled LDPC Codes Over the Binary Erasure Channel
- On the Universality of Spatially Coupled LDPC Codes Over Intersymbol Interference Channels
- Robust Performance Over Changing Intersymbol Interference Channels by Spatial Coupling