One step RSB scheme for the rate distortion function

Abstract

We apply statistical mechanics to an inverse problem of linear mapping to investigate the physics of the irreversible compression. We use the replica symmetry breaking (RSB) technique with a toy model to demonstrate the Shannon's result. The rate distortion function, which is widely known as the theoretical limit of the compression with a fidelity criterion, is derived using the Parisi one step RSB scheme. The bound can not be achieved in the sparsely-connected systems, where suboptimal solutions dominate the capacity.

8 pages, 2 figures

References in corpus (1)

• Statistical mechanics of lossy data compression using a non-monotonic perceptron

Cited by in corpus (14)

• Analysis of CDMA systems that are characterized by eigenvalue spectrum
• Parallel dynamics of disordered Ising spin systems on finitely connected directed random graphs with arbitrary degree distributions
• Statistical mechanics of lossy compression using multilayer perceptrons
• The theoretical capacity of the Parity Source Coder
• Statistical mechanics of lossy compression for non-monotonic multilayer perceptrons
• Efficient data compression from statistical physics of codes over finite fields
• Thermodynamic Construction of an One-Step Replica-Symmetry-Breaking Solution in Finite Connectivity Spin Glasses
• Typical Performance of Irregular Low-Density Generator-Matrix Codes for Lossy Compression
• Belief Propagation for Error Correcting Codes and Lossy Compression Using Multilayer Perceptrons
• Linear Complexity Lossy Compressor for Binary Redundant Memoryless Sources
• Parallel dynamics of continuous Hopfield model revisited
• Error correcting code using tree-like multilayer perceptron
• A statistical-mechanical view on source coding: physical compression and data compression
• Statistical mechanical analysis of a hierarchical random code ensemble in signal processing