QARV: Quantization-Aware ResNet VAE for Lossy Image Compression
arXiv:2302.08899 · doi:10.1109/TPAMI.2023.3322904
Abstract
This paper addresses the problem of lossy image compression, a fundamental problem in image processing and information theory that is involved in many real-world applications. We start by reviewing the framework of variational autoencoders (VAEs), a powerful class of generative probabilistic models that has a deep connection to lossy compression. Based on VAEs, we develop a novel scheme for lossy image compression, which we name quantization-aware ResNet VAE (QARV). Our method incorporates a hierarchical VAE architecture integrated with test-time quantization and quantization-aware training, without which efficient entropy coding would not be possible. In addition, we design the neural network architecture of QARV specifically for fast decoding and propose an adaptive normalization operation for variable-rate compression. Extensive experiments are conducted, and results show that QARV achieves variable-rate compression, high-speed decoding, and a better rate-distortion performance than existing baseline methods. The code of our method is publicly accessible at https://github.com/duanzhiihao/lossy-vae
arXiv commentFull version (19 pages, includes appendix) of the paper accepted by IEEE TPAMI
References in corpus (8)
- Variational image compression with a scale hyperprior
- End-to-end Optimized Image Compression
- Neural Image Compression via Non-Local Attention Optimization and Improved Context Modeling
- Non-local Attention Optimized Deep Image Compression
- Lossy Image Compression with Quantized Hierarchical VAEs
- High-Efficiency Lossy Image Coding Through Adaptive Neighborhood Information Aggregation
- High-Fidelity Variable-Rate Image Compression via Invertible Activation Transformation
- DeepFGS: Fine-Grained Scalable Coding for Learned Image Compression