Statistical mechanical analysis of a hierarchical random code ensemble in signal processing

Abstract

We study a random code ensemble with a hierarchical structure, which is closely related to the generalized random energy model with discrete energy values. Based on this correspondence, we analyze the hierarchical random code ensemble by using the replica method in two situations: lossy data compression and channel coding. For both the situations, the exponents of large deviation analysis characterizing the performance of the ensemble, the distortion rate of lossy data compression and the error exponent of channel coding in Gallager's formalism, are accessible by a generating function of the generalized random energy model. We discuss that the transitions of those exponents observed in the preceding work can be interpreted as phase transitions with respect to the replica number. We also show that the replica symmetry breaking plays an essential role in these transitions.

24 pages, 4 figures

References in corpus (17)

• The structural glass transition and the entropy of the metastable states
• The glassy phase of Gallager codes
• Typical Performance of Gallager-type Error-Correcting Codes
• The statistical mechanics of turbo codes
• Turbo codes: the phase transition
• Error-Correcting Codes That Nearly Saturate Shannon's Bound
• Finite-connectivity systems as error-correcting codes
• Statistical mechanics of lossy data compression using a non-monotonic perceptron
• Tighter Decoding Reliability Bound for Gallager's Error-Correcting Code
• One step RSB scheme for the rate distortion function
• Exact Analytic Continuation with Respect to the Replica Number in the Discrete Random Energy Model of Finite System Size
• Average and reliability error exponents in low-density parity-check codes
• Statistical mechanics of error exponents for error-correcting codes
• Replica symmetry breaking, complexity and spin representation in the generalized random energy model
• The Generalized Random Energy Model and its Application to the Statistical Physics of Ensembles of Hierarchical Codes
• On analyticity with respect to the replica number in random energy models I: an exact expression of the moment of the partition function
• On analyticity with respect to the replica number in random energy models II: zeros on the complex plane