Medical Image Retrieval using Deep Convolutional Neural Network

Abstract

With a widespread use of digital imaging data in hospitals, the size of medical image repositories is increasing rapidly. This causes difficulty in managing and querying these large databases leading to the need of content based medical image retrieval (CBMIR) systems. A major challenge in CBMIR systems is the semantic gap that exists between the low level visual information captured by imaging devices and high level semantic information perceived by human. The efficacy of such systems is more crucial in terms of feature representations that can characterize the high-level information completely. In this paper, we propose a framework of deep learning for CBMIR system by using deep Convolutional Neural Network (CNN) that is trained for classification of medical images. An intermodal dataset that contains twenty four classes and five modalities is used to train the network. The learned features and the classification results are used to retrieve medical images. For retrieval, best results are achieved when class based predictions are used. An average classification accuracy of 99.77% and a mean average precision of 0.69 is achieved for retrieval task. The proposed method is best suited to retrieve multimodal medical images for different body organs.

Submitted to Neurocomputing

References in corpus (2)

• Improving neural networks by preventing co-adaptation of feature detectors
• Automatic segmentation of MR brain images with a convolutional neural network

Cited by in corpus (18)

• An overview of deep learning in medical imaging focusing on MRI
• Medical Image Analysis using Convolutional Neural Networks: A Review
• A Decade Survey of Content Based Image Retrieval using Deep Learning
• Segmentation of Glioma Tumors in Brain Using Deep Convolutional Neural Network
• Deep Metric Learning-based Image Retrieval System for Chest Radiograph and its Clinical Applications in COVID-19
• Forecasting Megaelectron-Volt Electrons inside Earth's Outer Radiation Belt: PreMevE 2.0 Based on Supervised Machine Learning Algorithms
• Machine learning prediction for mean motion resonance behaviour -- The planar case
• Brain Tumor Image Retrieval via Multitask Learning
• Exploiting Latent Codes: Interactive Fashion Product Generation, Similar Image Retrieval, and Cross-Category Recommendation using Variational Autoencoders
• A CNN-RNN Architecture for Multi-Label Weather Recognition
• Deep Learning Based Decision Support for Medicine -- A Case Study on Skin Cancer Diagnosis
• Learning A 3D-CNN and Transformer Prior for Hyperspectral Image Super-Resolution
• Product1M: Towards Weakly Supervised Instance-Level Product Retrieval via Cross-modal Pretraining
• Enhancement of land-use change modeling using convolutional neural networks and convolutional denoising autoencoders
• Exploring Content Based Image Retrieval for Highly Imbalanced Melanoma Data using Style Transfer, Semantic Image Segmentation and Ensemble Learning
• Identifying partial mouse brain microscopy images from Allen reference atlas using a contrastively learned semantic space
• Advanced Multi-Architecture Deep Learning Framework for BIRADS-Based Mammographic Image Retrieval: Comprehensive Performance Analysis with Super-Ensemble Optimization
• Indicative Image Retrieval: Turning Blackbox Learning into Grey