Deep Triplet Hashing Network for Case-based Medical Image Retrieval
arXiv:2101.12346 · doi:10.1016/j.media.2021.101981
Abstract
Deep hashing methods have been shown to be the most efficient approximate nearest neighbor search techniques for large-scale image retrieval. However, existing deep hashing methods have a poor small-sample ranking performance for case-based medical image retrieval. The top-ranked images in the returned query results may be as a different class than the query image. This ranking problem is caused by classification, regions of interest (ROI), and small-sample information loss in the hashing space. To address the ranking problem, we propose an end-to-end framework, called Attention-based Triplet Hashing (ATH) network, to learn low-dimensional hash codes that preserve the classification, ROI, and small-sample information. We embed a spatial-attention module into the network structure of our ATH to focus on ROI information. The spatial-attention module aggregates the spatial information of feature maps by utilizing max-pooling, element-wise maximum, and element-wise mean operations jointly along the channel axis. The triplet cross-entropy loss can help to map the classification information of images and similarity between images into the hash codes. Extensive experiments on two case-based medical datasets demonstrate that our proposed ATH can further improve the retrieval performance compared to the state-of-the-art deep hashing methods and boost the ranking performance for small samples. Compared to the other loss methods, the triplet cross-entropy loss can enhance the classification performance and hash code-discriminability
arXiv comment12 pages, 6 figures, MedIA Journal
References in corpus (11)
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
- A Survey on Deep Learning in Medical Image Analysis
- Attention U-Net: Learning Where to Look for the Pancreas
- Simultaneous Feature Learning and Hash Coding with Deep Neural Networks
- REFUGE Challenge: A Unified Framework for Evaluating Automated Methods for Glaucoma Assessment from Fundus Photographs
- Particular object retrieval with integral max-pooling of CNN activations
- Bit-Scalable Deep Hashing with Regularized Similarity Learning for Image Retrieval and Person Re-identification
- Recent Advance in Content-based Image Retrieval: A Literature Survey
- Feature Learning based Deep Supervised Hashing with Pairwise Labels
- Instance Search via Instance Level Segmentation and Feature Representation
- Deeply Activated Salient Region for Instance Search