State-of-the-art in 360° Video/Image Processing: Perception, Assessment and Compression

Abstract

Nowadays, 360° video/image has been increasingly popular and drawn great attention. The spherical viewing range of 360° video/image accounts for huge data, which pose the challenges to 360° video/image processing in solving the bottleneck of storage, transmission, etc. Accordingly, the recent years have witnessed the explosive emergence of works on 360° video/image processing. In this paper, we review the state-of-the-art works on 360° video/image processing from the aspects of perception, assessment and compression. First, this paper reviews both datasets and visual attention modelling approaches for 360° video/image. Second, we survey the related works on both subjective and objective visual quality assessment (VQA) of 360° video/image. Third, we overview the compression approaches for 360° video/image, which either utilize the spherical characteristics or visual attention models. Finally, we summarize this overview paper and outlook the future research trends on 360° video/image processing.

arXiv commentSubmitted to IEEE J-STSP SI of Perception-driven 360-degree video processing as an Invited Overview Paper

References in corpus (7)

• SalGAN: Visual Saliency Prediction with Generative Adversarial Networks
• Predicting Head Movement in Panoramic Video: A Deep Reinforcement Learning Approach
• Assessing Visual Quality of Omnidirectional Videos
• Perceptual Quality Assessment of Omnidirectional Images
• Shallow and Deep Convolutional Networks for Saliency Prediction
• SaltiNet: Scan-path Prediction on 360 Degree Images using Saliency Volumes
• Saliency Prediction in the Deep Learning Era: Successes, Limitations, and Future Challenges

Cited by in corpus (1)

• Improving data-driven global weather prediction using deep convolutional neural networks on a cubed sphere