Enhancing Quality for HEVC Compressed Videos
arXiv:1709.06734 · doi:10.1109/TCSVT.2018.2867568
Abstract
The latest High Efficiency Video Coding (HEVC) standard has been increasingly applied to generate video streams over the Internet. However, HEVC compressed videos may incur severe quality degradation, particularly at low bit-rates. Thus, it is necessary to enhance the visual quality of HEVC videos at the decoder side. To this end, this paper proposes a Quality Enhancement Convolutional Neural Network (QE-CNN) method that does not require any modification of the encoder to achieve quality enhancement for HEVC. In particular, our QE-CNN method learns QE-CNN-I and QE-CNN-P models to reduce the distortion of HEVC I and P frames, respectively. The proposed method differs from the existing CNN-based quality enhancement approaches, which only handle intra-coding distortion and are thus not suitable for P frames. Our experimental results validate that our QE-CNN method is effective in enhancing quality for both I and P frames of HEVC videos. To apply our QE-CNN method in time-constrained scenarios, we further propose a Time-constrained Quality Enhancement Optimization (TQEO) scheme. Our TQEO scheme controls the computational time of QE-CNN to meet a target, meanwhile maximizing the quality enhancement. Next, the experimental results demonstrate the effectiveness of our TQEO scheme from the aspects of time control accuracy and quality enhancement under different time constraints. Finally, we design a prototype to implement our TQEO scheme in a real-time scenario.
arXiv commentSubmitted to IEEE T-CSVT
References in corpus (5)
- Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration
- A Convolutional Neural Network Approach for Post-Processing in HEVC Intra Coding
- Reducing Complexity of HEVC: A Deep Learning Approach
- Saliency-Guided Complexity Control for HEVC Decoding
- : Deep Dual-Domain Based Fast Restoration of JPEG-Compressed Images
Cited by in corpus (14)
- MFQE 2.0: A New Approach for Multi-frame Quality Enhancement on Compressed Video
- A DenseNet Based Approach for Multi-Frame In-Loop Filter in HEVC
- Deep Learning-Based Video Coding: A Review and A Case Study
- Early Exit or Not: Resource-Efficient Blind Quality Enhancement for Compressed Images
- ViSTRA2: Video Coding using Spatial Resolution and Effective Bit Depth Adaptation
- CVEGAN: A Perceptually-inspired GAN for Compressed Video Enhancement
- Non-Local ConvLSTM for Video Compression Artifact Reduction
- NTIRE 2021 Challenge on Quality Enhancement of Compressed Video: Methods and Results
- Boosting the Performance of Video Compression Artifact Reduction with Reference Frame Proposals and Frequency Domain Information
- Multi-level Wavelet-based Generative Adversarial Network for Perceptual Quality Enhancement of Compressed Video
- Recursive Fusion and Deformable Spatiotemporal Attention for Video Compression Artifact Reduction
- Residual-Guided In-Loop Filter Using Convolution Neural Network
- NTIRE 2021 Challenge on Quality Enhancement of Compressed Video: Dataset and Study
- A Foreground-background Parallel Compression with Residual Encoding for Surveillance Video