GraphIQA: Learning Distortion Graph Representations for Blind Image Quality Assessment
arXiv:2103.07666 · doi:10.1109/TMM.2022.3152942
Abstract
A good distortion representation is crucial for the success of deep blind image quality assessment (BIQA). However, most previous methods do not effectively model the relationship between distortions or the distribution of samples with the same distortion type but different distortion levels. In this work, we start from the analysis of the relationship between perceptual image quality and distortion-related factors, such as distortion types and levels. Then, we propose a Distortion Graph Representation (DGR) learning framework for IQA, named GraphIQA, in which each distortion is represented as a graph, i.e., DGR. One can distinguish distortion types by learning the contrast relationship between these different DGRs, and infer the ranking distribution of samples from different levels in a DGR. Specifically, we develop two sub-networks to learn the DGRs: a) Type Discrimination Network (TDN) that aims to embed DGR into a compact code for better discriminating distortion types and learning the relationship between types; b) Fuzzy Prediction Network (FPN) that aims to extract the distributional characteristics of the samples in a DGR and predicts fuzzy degrees based on a Gaussian prior. Experiments show that our GraphIQA achieves the state-of-the-art performance on many benchmark datasets of both synthetic and authentic distortions.
arXiv comment12 pages, 7 figures, published on IEEE Transactions on Multimedia
References in corpus (19)
- Adam: A Method for Stochastic Optimization
- Auto-Encoding Variational Bayes
- FaceNet: A Unified Embedding for Face Recognition and Clustering
- Semi-Supervised Classification with Graph Convolutional Networks
- In Defense of the Triplet Loss for Person Re-Identification
- YFCC100M: The New Data in Multimedia Research
- Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment
- Graph Convolutional Matrix Completion
- NIMA: Neural Image Assessment
- Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Network
- Massive Online Crowdsourced Study of Subjective and Objective Picture Quality
- Efficient Algorithms for t-distributed Stochastic Neighborhood Embedding
- Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wild
- Tensor Oriented No-Reference Light Field Image Quality Assessment
- No-Reference Light Field Image Quality Assessment Based on Spatial-Angular Measurement
- A Probabilistic Quality Representation Approach to Deep Blind Image Quality Prediction
- Bayesian Spatio-Temporal Graph Convolutional Network for Traffic Forecasting
- No-Reference Image Quality Assessment via Feature Fusion and Multi-Task Learning
- Learning to Blindly Assess Image Quality in the Laboratory and Wild