Confusing Image Quality Assessment: Towards Better Augmented Reality Experience

Abstract

With the development of multimedia technology, Augmented Reality (AR) has become a promising next-generation mobile platform. The primary value of AR is to promote the fusion of digital contents and real-world environments, however, studies on how this fusion will influence the Quality of Experience (QoE) of these two components are lacking. To achieve better QoE of AR, whose two layers are influenced by each other, it is important to evaluate its perceptual quality first. In this paper, we consider AR technology as the superimposition of virtual scenes and real scenes, and introduce visual confusion as its basic theory. A more general problem is first proposed, which is evaluating the perceptual quality of superimposed images, i.e., confusing image quality assessment. A ConFusing Image Quality Assessment (CFIQA) database is established, which includes 600 reference images and 300 distorted images generated by mixing reference images in pairs. Then a subjective quality perception study and an objective model evaluation experiment are conducted towards attaining a better understanding of how humans perceive the confusing images. An objective metric termed CFIQA is also proposed to better evaluate the confusing image quality. Moreover, an extended ARIQA study is further conducted based on the CFIQA study. We establish an ARIQA database to better simulate the real AR application scenarios, which contains 20 AR reference images, 20 background (BG) reference images, and 560 distorted images generated from AR and BG references, as well as the correspondingly collected subjective quality ratings. We also design three types of full-reference (FR) IQA metrics to study whether we should consider the visual confusion when designing corresponding IQA algorithms. An ARIQA metric is finally proposed for better evaluating the perceptual quality of AR images.

References in corpus (13)

• Adam: A Method for Stochastic Optimization
• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index
• Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment
• Image Quality Assessment: Unifying Structure and Texture Similarity
• Richer Convolutional Features for Edge Detection
• KonIQ-10k: Towards an ecologically valid and large-scale IQA database
• KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessment
• Perceptual Quality Assessment of Omnidirectional Images
• Unified Image and Video Saliency Modeling
• A Perceptually Weighted Rank Correlation Indicator for Objective Image Quality Assessment
• Subjective and Objective Visual Quality Assessment of Textured 3D Meshes
• Towards a QoE Model to Evaluate Holographic Augmented Reality Devices

Cited by in corpus (3)

• Systematic Review of Extended Reality for Smart Built Environments Lighting Design Simulations
• Immersive Multimedia Communication: State-of-the-Art on eXtended Reality Streaming
• Smart Glasses for CVI: Co-Designing Extended Reality Solutions to Support Environmental Perception by People with Cerebral Visual Impairment