LLIC: Large Receptive Field Transform Coding with Adaptive Weights for Learned Image Compression
arXiv:2304.09571 · doi:10.1109/TMM.2024.3416831
Abstract
The effective receptive field (ERF) plays an important role in transform coding, which determines how much redundancy can be removed during transform and how many spatial priors can be utilized to synthesize textures during inverse transform. Existing methods rely on stacks of small kernels, whose ERFs remain insufficiently large, or heavy non-local attention mechanisms, which limit the potential of high-resolution image coding. To tackle this issue, we propose Large Receptive Field Transform Coding with Adaptive Weights for Learned Image Compression (LLIC). Specifically, for the first time in the learned image compression community, we introduce a few large kernelbased depth-wise convolutions to reduce more redundancy while maintaining modest complexity. Due to the wide range of image diversity, we further propose a mechanism to augment convolution adaptability through the self-conditioned generation of weights. The large kernels cooperate with non-linear embedding and gate mechanisms for better expressiveness and lighter pointwise interactions. Our investigation extends to refined training methods that unlock the full potential of these large kernels. Moreover, to promote more dynamic inter-channel interactions, we introduce an adaptive channel-wise bit allocation strategy that autonomously generates channel importance factors in a self-conditioned manner. To demonstrate the effectiveness of the proposed transform coding, we align the entropy model to compare with existing transform methods and obtain models LLIC-STF, LLIC-ELIC, and LLIC-TCM. Extensive experiments demonstrate that our proposed LLIC models have significant improvements over the corresponding baselines and reduce the BD-Rate by 9.49%, 9.47%, 10.94% on Kodak over VTM-17.0 Intra, respectively. Our LLIC models achieve state-of-the-art performances and better trade-offs between performance and complexity.
Accepted to IEEE Transactions on Multimedia 2024
References in corpus (16)
- Auto-Encoding Variational Bayes
- Gaussian Error Linear Units (GELUs)
- Squeeze-and-Excitation Networks
- Variational image compression with a scale hyperprior
- End-to-end Optimized Image Compression
- Image and Video Compression with Neural Networks: A Review
- Density Modeling of Images using a Generalized Normalization Transformation
- Neural Image Compression via Non-Local Attention Optimization and Improved Context Modeling
- Non-local Attention Optimized Deep Image Compression
- CompressAI: a PyTorch library and evaluation platform for end-to-end compression research
- Causal Contextual Prediction for Learned Image Compression
- MLIC: Multi-Reference Entropy Model for Learned Image Compression
- A Comprehensive Benchmark for Single Image Compression Artifacts Reduction
- Contextformer: A Transformer with Spatio-Channel Attention for Context Modeling in Learned Image Compression
- Learning Accurate Entropy Model with Global Reference for Image Compression
- Computationally-Efficient Neural Image Compression with Shallow Decoders