Comparison of Image Quality Models for Optimization of Image Processing Systems

Abstract

The performance of objective image quality assessment (IQA) models has been evaluated primarily by comparing model predictions to human quality judgments. Perceptual datasets gathered for this purpose have provided useful benchmarks for improving IQA methods, but their heavy use creates a risk of overfitting. Here, we perform a large-scale comparison of IQA models in terms of their use as objectives for the optimization of image processing algorithms. Specifically, we use eleven full-reference IQA models to train deep neural networks for four low-level vision tasks: denoising, deblurring, super-resolution, and compression. Subjective testing on the optimized images allows us to rank the competing models in terms of their perceptual performance, elucidate their relative advantages and disadvantages in these tasks, and propose a set of desirable properties for incorporation into future IQA models.

References in corpus (8)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
• Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index
• End-to-end Optimized Image Compression
• Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment
• The Perception-Distortion Tradeoff
• Image Quality Assessment: Unifying Structure and Texture Similarity
• Perceptually Optimized Image Rendering

Cited by in corpus (14)

• Image Quality Assessment: Unifying Structure and Texture Similarity
• Image Quality Assessment using Contrastive Learning
• Image Quality Assessment for Magnetic Resonance Imaging
• Locally Adaptive Structure and Texture Similarity for Image Quality Assessment
• ColorVideoVDP: A visual difference predictor for image, video and display distortions
• DeepWSD: Projecting Degradations in Perceptual Space to Wasserstein Distance in Deep Feature Space
• A robust and scalable framework for hallucination detection in virtual tissue staining and digital pathology
• Imperceptible Adversarial Examples by Spatial Chroma-Shift
• Impact of loss functions on the performance of a deep neural network designed to restore low-dose digital mammography
• Atmospheric Turbulence-Immune Free Space Optical Communication System based on Discrete-Time Analog Transmission
• Machine Perception-Driven Image Compression: A Layered Generative Approach
• Global Adaptive Filtering Layer for Computer Vision
• Evaluating the Stability of Deep Image Quality Assessment With Respect to Image Scaling
• GRay: Ray Tracing 3D Gaussians Near the Speed of Splats