Weakly-Supervised Cross-Domain Adaptation for Endoscopic Lesions Segmentation

Abstract

Weakly-supervised learning has attracted growing research attention on medical lesions segmentation due to significant saving in pixel-level annotation cost. However, 1) most existing methods require effective prior and constraints to explore the intrinsic lesions characterization, which only generates incorrect and rough prediction; 2) they neglect the underlying semantic dependencies among weakly-labeled target enteroscopy diseases and fully-annotated source gastroscope lesions, while forcefully utilizing untransferable dependencies leads to the negative performance. To tackle above issues, we propose a new weakly-supervised lesions transfer framework, which can not only explore transferable domain-invariant knowledge across different datasets, but also prevent the negative transfer of untransferable representations. Specifically, a Wasserstein quantified transferability framework is developed to highlight widerange transferable contextual dependencies, while neglecting the irrelevant semantic characterizations. Moreover, a novel selfsupervised pseudo label generator is designed to equally provide confident pseudo pixel labels for both hard-to-transfer and easyto-transfer target samples. It inhibits the enormous deviation of false pseudo pixel labels under the self-supervision manner. Afterwards, dynamically-searched feature centroids are aligned to narrow category-wise distribution shift. Comprehensive theoretical analysis and experiments show the superiority of our model on the endoscopic dataset and several public datasets.

arXiv commentAccepted to IEEE Transactions on Circuits and Systems for Video Technology (TCSVT 2020)

References in corpus (9)

• Continuous control with deep reinforcement learning
• Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
• ADVENT: Adversarial Entropy Minimization for Domain Adaptation in Semantic Segmentation
• FCNs in the Wild: Pixel-level Adversarial and Constraint-based Adaptation
• Curriculum Domain Adaptation for Semantic Segmentation of Urban Scenes
• Constrained-CNN losses for weakly supervised segmentation
• Weakly Supervised Adversarial Domain Adaptation for Semantic Segmentation in Urban Scenes
• Playing for Data: Ground Truth from Computer Games
• Domain Adaptation for Semantic Segmentation with Maximum Squares Loss