Statistical mechanics of typical set decoding
arXiv:cond-mat/0106323 · doi:10.1103/PhysRevE.66.036125
Abstract
The performance of ``typical set (pairs) decoding'' for ensembles of Gallager's linear code is investigated using statistical physics. In this decoding, error happens when the information transmission is corrupted by an untypical noise or two or more typical sequences satisfy the parity check equation provided by the received codeword for which a typical noise is added. We show that the average error rate for the latter case over a given code ensemble can be tightly evaluated using the replica method, including the sensitivity to the message length. Our approach generally improves the existing analysis known in information theory community, which was reintroduced by MacKay (1999) and believed as most accurate to date.
arXiv comment7 pages
References in corpus (6)
- Statistical mechanics of image restoration and error-correcting codes
- Typical Performance of Gallager-type Error-Correcting Codes
- The Statistical Physics of Regular Low-Density Parity-Check Error-Correcting Codes
- Equilibrium Ensemble Approach to Disordered Systems I: General Theory, Exact Results
- Statistical Mechanics of Low-Density Parity Check Error-Correcting Codes over Galois Fields
- Tighter Decoding Reliability Bound for Gallager's Error-Correcting Code
Cited by in corpus (3)
- Optimum estimation via gradients of partition functions and information measures: a statistical-mechanical perspective
- Code optimization, frozen glassy phase and improved decoding algorithms for low-density parity-check codes
- Analysis of Mismatched Estimation Errors Using Gradients of Partition Functions