Self-supervised Lesion Change Detection and Localisation in Longitudinal Multiple Sclerosis Brain Imaging

Abstract

Longitudinal imaging forms an essential component in the management and follow-up of many medical conditions. The presence of lesion changes on serial imaging can have significant impact on clinical decision making, highlighting the important role for automated change detection. Lesion changes can represent anomalies in serial imaging, which implies a limited availability of annotations and a wide variety of possible changes that need to be considered. Hence, we introduce a new unsupervised anomaly detection and localisation method trained exclusively with serial images that do not contain any lesion changes. Our training automatically synthesises lesion changes in serial images, introducing detection and localisation pseudo-labels that are used to self-supervise the training of our model. Given the rarity of these lesion changes in the synthesised images, we train the model with the imbalance robust focal Tversky loss. When compared to supervised models trained on different datasets, our method shows competitive performance in the detection and localisation of new demyelinating lesions on longitudinal magnetic resonance imaging in multiple sclerosis patients. Code for the models will be made available on GitHub.

arXiv commentProvisional accepted for MICCAI 2021

References in corpus (9)

• Improved Regularization of Convolutional Neural Networks with Cutout
• Deeply-Supervised Nets
• Automated brain extraction of multi-sequence MRI using artificial neural networks
• Automatic lung segmentation in routine imaging is primarily a data diversity problem, not a methodology problem
• CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features
• Fully Convolutional Network Ensembles for White Matter Hyperintensities Segmentation in MR Images
• Multi-branch Convolutional Neural Network for Multiple Sclerosis Lesion Segmentation
• Learning Implicit Brain MRI Manifolds with Deep Learning
• CNN-based Segmentation of Medical Imaging Data