Modeling Lost Information in Lossy Image Compression
arXiv:2006.11999
Abstract
Lossy image compression is one of the most commonly used operators for digital images. Most recently proposed deep-learning-based image compression methods leverage the auto-encoder structure, and reach a series of promising results in this field. The images are encoded into low dimensional latent features first, and entropy coded subsequently by exploiting the statistical redundancy. However, the information lost during encoding is unfortunately inevitable, which poses a significant challenge to the decoder to reconstruct the original images. In this work, we propose a novel invertible framework called Invertible Lossy Compression (ILC) to largely mitigate the information loss problem. Specifically, ILC introduces an invertible encoding module to replace the encoder-decoder structure to produce the low dimensional informative latent representation, meanwhile, transform the lost information into an auxiliary latent variable that won't be further coded or stored. The latent representation is quantized and encoded into bit-stream, and the latent variable is forced to follow a specified distribution, i.e. isotropic Gaussian distribution. In this way, recovering the original image is made tractable by easily drawing a surrogate latent variable and applying the inverse pass of the module with the sampled variable and decoded latent features. Experimental results demonstrate that with a new component replacing the auto-encoder in image compression methods, ILC can significantly outperform the baseline method on extensive benchmark datasets by combining with the existing compression algorithms.
References in corpus (11)
- Adam: A Method for Stochastic Optimization
- Distilling the Knowledge in a Neural Network
- Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation
- Do Deep Nets Really Need to be Deep?
- Image and Video Compression with Neural Networks: A Review
- Joint Autoregressive and Hierarchical Priors for Learned Image Compression
- Context-adaptive Entropy Model for End-to-end Optimized Image Compression
- Guided Image Generation with Conditional Invertible Neural Networks
- Analyzing Inverse Problems with Invertible Neural Networks
- Computationally Efficient Neural Image Compression
- Invertible Image Rescaling