Evaluation of Retinal Image Quality Assessment Networks in Different Color-spaces

Abstract

Retinal image quality assessment (RIQA) is essential for controlling the quality of retinal imaging and guaranteeing the reliability of diagnoses by ophthalmologists or automated analysis systems. Existing RIQA methods focus on the RGB color-space and are developed based on small datasets with binary quality labels (i.e., `Accept' and `Reject'). In this paper, we first re-annotate an Eye-Quality (EyeQ) dataset with 28,792 retinal images from the EyePACS dataset, based on a three-level quality grading system (i.e., `Good', `Usable' and `Reject') for evaluating RIQA methods. Our RIQA dataset is characterized by its large-scale size, multi-level grading, and multi-modality. Then, we analyze the influences on RIQA of different color-spaces, and propose a simple yet efficient deep network, named Multiple Color-space Fusion Network (MCF-Net), which integrates the different color-space representations at both a feature-level and prediction-level to predict image quality grades. Experiments on our EyeQ dataset show that our MCF-Net obtains a state-of-the-art performance, outperforming the other deep learning methods. Furthermore, we also evaluate diabetic retinopathy (DR) detection methods on images of different quality, and demonstrate that the performances of automated diagnostic systems are highly dependent on image quality.

arXiv commentAccepted by MICCAI 2019. Corrected two typos in Table 1 as: (1) in training set, the number of "Usable + All" should be '1,876'; (2) In testing set, the number of "Total + DR-0" should be '11,362'. Project page: https://github.com/hzfu/EyeQ

References in corpus (5)

• CE-Net: Context Encoder Network for 2D Medical Image Segmentation
• Joint Optic Disc and Cup Segmentation Based on Multi-label Deep Network and Polar Transformation
• Disc-aware Ensemble Network for Glaucoma Screening from Fundus Image
• Systematic evaluation of CNN advances on the ImageNet
• Structure-preserving Guided Retinal Image Filtering and Its Application for Optic Disc Analysis

Cited by in corpus (10)

• Deep Learning Predicts Prevalent and Incident Parkinson's Disease From UK Biobank Fundus Imaging
• Enhancing and Adapting in the Clinic: Source-free Unsupervised Domain Adaptation for Medical Image Enhancement
• Degradation-invariant Enhancement of Fundus Images via Pyramid Constraint Network
• Frequency learning for image classification
• Modeling and Enhancing Low-quality Retinal Fundus Images
• Adversarial Exposure Attack on Diabetic Retinopathy Imagery Grading
• VascX Models: Model Ensembles for Retinal Vascular Analysis from Color Fundus Images
• Integrating Deep Learning with Fundus and Optical Coherence Tomography for Cardiovascular Disease Prediction
• Versatile Cataract Fundus Image Restoration Model Utilizing Unpaired Cataract and High-quality Images
• The Utility of Decorrelating Colour Spaces in Vector Quantised Variational Autoencoders