Learning End-to-End Lossy Image Compression: A Benchmark
arXiv:2002.03711
Abstract
Image compression is one of the most fundamental techniques and commonly used applications in the image and video processing field. Earlier methods built a well-designed pipeline, and efforts were made to improve all modules of the pipeline by handcrafted tuning. Later, tremendous contributions were made, especially when data-driven methods revitalized the domain with their excellent modeling capacities and flexibility in incorporating newly designed modules and constraints. Despite great progress, a systematic benchmark and comprehensive analysis of end-to-end learned image compression methods are lacking. In this paper, we first conduct a comprehensive literature survey of learned image compression methods. The literature is organized based on several aspects to jointly optimize the rate-distortion performance with a neural network, i.e., network architecture, entropy model and rate control. We describe milestones in cutting-edge learned image-compression methods, review a broad range of existing works, and provide insights into their historical development routes. With this survey, the main challenges of image compression methods are revealed, along with opportunities to address the related issues with recent advanced learning methods. This analysis provides an opportunity to take a further step towards higher-efficiency image compression. By introducing a coarse-to-fine hyperprior model for entropy estimation and signal reconstruction, we achieve improved rate-distortion performance, especially on high-resolution images. Extensive benchmark experiments demonstrate the superiority of our model in rate-distortion performance and time complexity on multi-core CPUs and GPUs. Our project website is available at https://huzi96.github.io/compression-bench.html.
arXiv commentAccepted for publication in IEEE Transactions on Pattern Analysis and Machine Intelligence. Website available at https://huzi96.github.io/compression-bench.html
References in corpus (17)
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
- Conditional Generative Adversarial Nets
- Conditional Image Generation with PixelCNN Decoders
- Pixel Recurrent Neural Networks
- Variational image compression with a scale hyperprior
- End-to-end Optimized Image Compression
- The Perception-Distortion Tradeoff
- Soft-to-Hard Vector Quantization for End-to-End Learning Compressible Representations
- Joint Autoregressive and Hierarchical Priors for Learned Image Compression
- Density Modeling of Images using a Generalized Normalization Transformation
- Context-adaptive Entropy Model for End-to-end Optimized Image Compression
- Video Coding for Machines: A Paradigm of Collaborative Compression and Intelligent Analytics
- A Comprehensive Benchmark for Single Image Compression Artifacts Reduction
- Improving Inference for Neural Image Compression
- On The Classification-Distortion-Perception Tradeoff
- Multi-scale and Context-adaptive Entropy Model for Image Compression
- Target-Quality Image Compression with Recurrent, Convolutional Neural Networks