MGANet: A Robust Model for Quality Enhancement of Compressed Video
arXiv:1811.09150
Abstract
In video compression, most of the existing deep learning approaches concentrate on the visual quality of a single frame, while ignoring the useful priors as well as the temporal information of adjacent frames. In this paper, we propose a multi-frame guided attention network (MGANet) to enhance the quality of compressed videos. Our network is composed of a temporal encoder that discovers inter-frame relations, a guided encoder-decoder subnet that encodes and enhances the visual patterns of target frame, and a multi-supervised reconstruction component that aggregates information to predict details. We design a bidirectional residual convolutional LSTM unit to implicitly discover frames variations over time with respect to the target frame. Meanwhile, the guided map is proposed to guide our network to concentrate more on the block boundary. Our approach takes advantage of intra-frame prior information and inter-frame information to improve the quality of compressed video. Experimental results show the robustness and superior performance of the proposed method.Code is available at https://github.com/mengab/MGANet
12 pages, 12 figures
References in corpus (5)
- Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
- Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
- Image Restoration Using Very Deep Convolutional Encoder-Decoder Networks with Symmetric Skip Connections
- A Convolutional Neural Network Approach for Post-Processing in HEVC Intra Coding
- Look, Listen and Learn - A Multimodal LSTM for Speaker Identification
Cited by in corpus (6)
- Content-Aware Unsupervised Deep Homography Estimation
- Frame-Recurrent Video Inpainting by Robust Optical Flow Inference
- Two-phase Hair Image Synthesis by Self-Enhancing Generative Model
- Semi-supervised Skin Detection by Network with Mutual Guidance
- Multi-level Wavelet-based Generative Adversarial Network for Perceptual Quality Enhancement of Compressed Video
- Enhancing Quality for VVC Compressed Videos by Jointly Exploiting Spatial Details and Temporal Structure