Statistical mechanics of image restoration and error-correcting codes

Abstract

We develop a statistical-mechanical formulation for image restoration and error-correcting codes. These problems are shown to be equivalent to the Ising spin glass with ferromagnetic bias under random external fields. We prove that the quality of restoration/decoding is maximized at a specific set of parameter values determined by the source and channel properties. For image restoration in mean-field system a line of optimal performance is shown to exist in the parameter space. These results are illustrated by solving exactly the infinite-range model. The solutions enable us to determine how precisely one should estimate unknown parameters. Monte Carlo simulations are carried out to see how far the conclusions from the infinite-range model are applicable to the more realistic two-dimensional case in image restoration.

20 pages, 9 figures, ReVTeX

Cited by in corpus (45)

• Statistical physics of inference: Thresholds and algorithms
• Analysis of CDMA systems that are characterized by eigenvalue spectrum
• Generalization of the cavity method for adiabatic evolution of Gibbs states
• Digital Quantum Simulation of the Statistical Mechanics of a Frustrated Magnet
• Application of the quantum spin glass theory to image restoration
• Phase transitions in random Potts systems and the community detection problem: spin-glass type and dynamic perspectives
• Statistical mechanics of lossy data compression using a non-monotonic perceptron
• Multispin Ising spin glasses with ferromagnetic interactions
• Image restoration using the Q-Ising spin glass
• Propagating beliefs in spin glass models
• Glassy dynamics as a melting process (On melting dynamics and the glass transition, Part II)
• Transient dynamics for sequence processing neural networks
• Dynamics of the maximum marginal likelihood hyper-parameter estimation in image restoration : gradient descent vs. EM algorithm
• Typical performance of low-density parity-check codes over general symmetric channels
• Statistical Mechanics of the Bayesian Image Restoration under Spatially Correlated Noise
• Statistical mechanics of typical set decoding
• Statistical mechanics of lossy compression using multilayer perceptrons
• Ensemble Inequivalence and the Spin-Glass Transition
• Statistical mechanics of lossy compression for non-monotonic multilayer perceptrons
• Maximizing Influence in an Ising Network: A Mean-Field Optimal Solution
• Gibbs Markov Random Fields with Continuous Values based on the Modified Planar Rotator Model
• Complex Replica Zeros of $\pm J$ Ising Spin Glass at Zero Temperature
• Kalikow-type decomposition for multicolor infinite range particle systems
• Error-correcting codes and image restoration with multiple stages of dynamics
• Multi-State Image Restoration by Transmission of Bit-Decomposed Data
• Infinite-range transverse field Ising models and quantum computation
• Deterministic flows of order-parameters in stochastic processes of quantum Monte Carlo method
• Many-body spin glasses in the microcanonical ensemble
• Code optimization, frozen glassy phase and improved decoding algorithms for low-density parity-check codes
• Naive mean field approximation for image restoration
• Statistical mechanical evaluation of spread spectrum watermarking model with image restoration
• Spatial data modeling by means of Gibbs Markov random fields based on a generalized planar rotator model
• Active image restoration
• Parallel dynamics of continuous Hopfield model revisited
• Belief Propagation for Error Correcting Codes and Lossy Compression Using Multilayer Perceptrons
• Weight vs Magnetization Enumerator for Gallager Codes
• Efficient and Scalable Approach to Equilibrium Conditional Simulation of Gibbs Markov Random Fields
• Training for Channel Estimation in Nonlinear Multi-Antenna Transceivers
• Error correcting code using tree-like multilayer perceptron
• Replica Symmetry Breaking in Random Non-Hermitian Systems
• Stability in microcanonical many-body spin glasses
• A Note on the Equivalence of Gibbs Free Energy and Information Theoretic Capacity
• Naive Mean Field Approximation for the Error Correcting Code
• Bayesian Restoration of Digital Images Employing Markov Chain Monte Carlo a Review
• Capacity of Multiple One-Bit Transceivers in a Rayleigh Environment