A combined full-reference image quality assessment approach based on convolutional activation maps

Abstract

The goal of full-reference image quality assessment (FR-IQA) is to predict the quality of an image as perceived by human observers with using its pristine, reference counterpart. In this study, we explore a novel, combined approach which predicts the perceptual quality of a distorted image by compiling a feature vector from convolutional activation maps. More specifically, a reference-distorted image pair is run through a pretrained convolutional neural network and the activation maps are compared with a traditional image similarity metric. Subsequently, the resulted feature vector is mapped onto perceptual quality scores with the help of a trained support vector regressor. A detailed parameter study is also presented in which the design choices of the proposed method is reasoned. Furthermore, we study the relationship between the amount of training images and the prediction performance. Specifically, it is demonstrated that the proposed method can be trained with few amount of data to reach high prediction performance. Our best proposal - ActMapFeat - is compared to the state-of-the-art on six publicly available benchmark IQA databases, such as KADID-10k, TID2013, TID2008, MDID, CSIQ, and VCL-FER. Specifically, our method is able to significantly outperform the state-of-the-art on these benchmark databases.

References in corpus (12)

• Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index
• Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment
• Image Quality Assessment: Unifying Structure and Texture Similarity
• A Haar Wavelet-Based Perceptual Similarity Index for Image Quality Assessment
• Mean Deviation Similarity Index: Efficient and Reliable Full-Reference Image Quality Evaluator
• Perceptual Image Quality Assessment through Spectral Analysis of Error Representations
• PerSIM: Multi-resolution Image Quality Assessment in the Perceptually Uniform Color Domain
• CSV: Image Quality Assessment Based on Color, Structure, and Visual System
• MS-UNIQUE: Multi-model and Sharpness-weighted Unsupervised Image Quality Estimation
• Center Emphasized Visual Saliency and a Contrast-based Full Reference Image Quality Index
• ReSIFT: Reliability-Weighted SIFT-based Image Quality Assessment
• BLeSS: Bio-inspired Low-level Spatiochromatic Similarity Assisted Image Quality Assessment