The random energy model in a magnetic field and joint source-channel coding
arXiv:0803.2789 · doi:10.1016/j.physa.2008.05.040
Abstract
We demonstrate that there is an intimate relationship between the magnetic properties of Derrida's random energy model (REM) of spin glasses and the problem of joint source--channel coding in Information Theory. In particular, typical patterns of erroneously decoded messages in the coding problem have ``magnetization'' properties that are analogous to those of the REM in certain phases, where the non--uniformity of the distribution of the source in the coding problem, plays the role of an external magnetic field applied to the REM. We also relate the ensemble performance (random coding exponents) of joint source--channel codes to the free energy of the REM in its different phases.
25 pages, 2 figures, submitted to Physica A: Startistical Mechanics and its Applications
References in corpus (11)
- The glassy phase of Gallager codes
- Tight bounds for LDPC and LDGM codes under MAP decoding
- The Dynamic Phase Transition for Decoding Algorithms
- Error-Correcting Codes That Nearly Saturate Shannon's Bound
- Error Exponents of Erasure/List Decoding Revisited via Moments of Distance Enumerators
- Tighter Decoding Reliability Bound for Gallager's Error-Correcting Code
- Statistical mechanics of error exponents for error-correcting codes
- A statistical mechanical interpretation of instantaneous codes
- Error threshold in optimal coding, numerical criteria and classes of universalities for complexity
- Modern Coding Theory: The Statistical Mechanics and Computer Science Point of View
- Two Lectures on Iterative Coding and Statistical Mechanics