Video Compression with CNN-based Post Processing
arXiv:2009.07583 · doi:10.1109/MMUL.2021.3052437
Abstract
In recent years, video compression techniques have been significantly challenged by the rapidly increased demands associated with high quality and immersive video content. Among various compression tools, post-processing can be applied on reconstructed video content to mitigate visible compression artefacts and to enhance overall perceptual quality. Inspired by advances in deep learning, we propose a new CNN-based post-processing approach, which has been integrated with two state-of-the-art coding standards, VVC and AV1. The results show consistent coding gains on all tested sequences at various spatial resolutions, with average bit rate savings of 4.0% and 5.8% against original VVC and AV1 respectively (based on the assessment of PSNR). This network has also been trained with perceptually inspired loss functions, which have further improved reconstruction quality based on perceptual quality assessment (VMAF), with average coding gains of 13.9% over VVC and 10.5% against AV1.
References in corpus (5)
- End-to-end Optimized Image Compression
- The relativistic discriminator: a key element missing from standard GAN
- Deep Learning-Based Video Coding: A Review and A Case Study
- ViSTRA2: Video Coding using Spatial Resolution and Effective Bit Depth Adaptation
- Perceptually-inspired super-resolution of compressed videos
Cited by in corpus (8)
- BVI-DVC: A Training Database for Deep Video Compression
- CVEGAN: A Perceptually-inspired GAN for Compressed Video Enhancement
- BVI-AOM: A New Training Dataset for Deep Video Compression Optimization
- Immersive Video Compression using Implicit Neural Representations
- RMT-BVQA: Recurrent Memory Transformer-based Blind Video Quality Assessment for Enhanced Video Content
- DaBiT: Depth and Blur informed Transformer for Video Focal Deblurring
- Enhancing HDR Video Compression through CNN-based Effective Bit Depth Adaptation
- ViSTRA3: Video Coding with Deep Parameter Adaptation and Post Processing