Universal Lesion Detection by Learning from Multiple Heterogeneously Labeled Datasets
arXiv:2005.13753
Abstract
Lesion detection is an important problem within medical imaging analysis. Most previous work focuses on detecting and segmenting a specialized category of lesions (e.g., lung nodules). However, in clinical practice, radiologists are responsible for finding all possible types of anomalies. The task of universal lesion detection (ULD) was proposed to address this challenge by detecting a large variety of lesions from the whole body. There are multiple heterogeneously labeled datasets with varying label completeness: DeepLesion, the largest dataset of 32,735 annotated lesions of various types, but with even more missing annotation instances; and several fully-labeled single-type lesion datasets, such as LUNA for lung nodules and LiTS for liver tumors. In this work, we propose a novel framework to leverage all these datasets together to improve the performance of ULD. First, we learn a multi-head multi-task lesion detector using all datasets and generate lesion proposals on DeepLesion. Second, missing annotations in DeepLesion are retrieved by a new method of embedding matching that exploits clinical prior knowledge. Last, we discover suspicious but unannotated lesions using knowledge transfer from single-type lesion detectors. In this way, reliable positive and negative regions are obtained from partially-labeled and unlabeled images, which are effectively utilized to train ULD. To assess the clinically realistic protocol of 3D volumetric ULD, we fully annotated 1071 CT sub-volumes in DeepLesion. Our method outperforms the current state-of-the-art approach by 29% in the metric of average sensitivity.
References in corpus (15)
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
- A Survey on Deep Learning in Medical Image Analysis
- Distilling the Knowledge in a Neural Network
- Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challenge
- The Liver Tumor Segmentation Benchmark (LiTS)
- A large annotated medical image dataset for the development and evaluation of segmentation algorithms
- Improving Computer-aided Detection using Convolutional Neural Networks and Random View Aggregation
- Evaluate the Malignancy of Pulmonary Nodules Using the 3D Deep Leaky Noisy-or Network
- The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scale
- Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentation
- Few-Example Object Detection with Model Communication
- On the limits of cross-domain generalization in automated X-ray prediction
- Prior-aware Neural Network for Partially-Supervised Multi-Organ Segmentation
- Data Distillation: Towards Omni-Supervised Learning
- Less is More: Simultaneous View Classification and Landmark Detection for Abdominal Ultrasound Images