KonIQ-10k: Towards an ecologically valid and large-scale IQA database
arXiv:1803.08489 · doi:10.1109/TIP.2020.2967829
Abstract
The main challenge in applying state-of-the-art deep learning methods to predict image quality in-the-wild is the relatively small size of existing quality scored datasets. The reason for the lack of larger datasets is the massive resources required in generating diverse and publishable content. We present a new systematic and scalable approach to create large-scale, authentic and diverse image datasets for Image Quality Assessment (IQA). We show how we built an IQA database, KonIQ-10k, consisting of 10,073 images, on which we performed very large scale crowdsourcing experiments in order to obtain reliable quality ratings from 1,467 crowd workers (1.2 million ratings). We argue for its ecological validity by analyzing the diversity of the dataset, by comparing it to state-of-the-art IQA databases, and by checking the reliability of our user studies.
Image database, image quality assessment, diversity sampling, crowdsourcing
References in corpus (2)
Cited by in corpus (19)
- Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wild
- UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content
- Image Quality Assessment using Contrastive Learning
- A Deep Learning based No-reference Quality Assessment Model for UGC Videos
- RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Content
- Blind Quality Assessment for in-the-Wild Images via Hierarchical Feature Fusion and Iterative Mixed Database Training
- Norm-in-Norm Loss with Faster Convergence and Better Performance for Image Quality Assessment
- Confusing Image Quality Assessment: Towards Better Augmented Reality Experience
- Large Multi-modality Model Assisted AI-Generated Image Quality Assessment
- SUR-FeatNet: Predicting the Satisfied User Ratio Curvefor Image Compression with Deep Feature Learning
- Gap-closing Matters: Perceptual Quality Evaluation and Optimization of Low-Light Image Enhancement
- Consolidated Dataset and Metrics for High-Dynamic-Range Image Quality
- Unveiling The Factors of Aesthetic Preferences with Explainable AI
- MS-SCANet: A Multiscale Transformer-Based Architecture with Dual Attention for No-Reference Image Quality Assessment
- Generalised Score Distribution: A Two-Parameter Discrete Distribution Accurately Describing Responses from Quality of Experience Subjective Experiments
- Fairness in generative modeling
- Building Reasonable Inference for Vision-Language Models in Blind Image Quality Assessment
- MMP-2K: A Benchmark Multi-Labeled Macro Photography Image Quality Assessment Database
- Fill2SR: Repurposing Inpainting Diffusion Transformers for Real-World Super-Resolution