A Deep Learning Framework for Spatiotemporal Ultrasound Localization Microscopy

Abstract

Ultrasound Localization Microscopy can resolve the microvascular bed down to a few micrometers. To achieve such performance microbubble contrast agents must perfuse the entire microvascular network. Microbubbles are then located individually and tracked over time to sample individual vessels, typically over hundreds of thousands of images. To overcome the fundamental limit of diffraction and achieve a dense reconstruction of the network, low microbubble concentrations must be used, which lead to acquisitions lasting several minutes. Conventional processing pipelines are currently unable to deal with interference from multiple nearby microbubbles, further reducing achievable concentrations. This work overcomes this problem by proposing a Deep Learning approach to recover dense vascular networks from ultrasound acquisitions with high microbubble concentrations. A realistic mouse brain microvascular network, segmented from 2-photon microscopy, was used to train a three-dimensional convolutional neural network based on a V-net architecture. Ultrasound data sets from multiple microbubbles flowing through the microvascular network were simulated and used as ground truth to train the 3D CNN to track microbubbles. The 3D-CNN approach was validated in silico using a subset of the data and in vivo on a rat brain acquisition. In silico, the CNN reconstructed vascular networks with higher precision (81%) than a conventional ULM framework (70%). In vivo, the CNN could resolve micro vessels as small as 10 $\mu$m with an increase in resolution when compared against a conventional approach.

arXiv commentCopyright 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

References in corpus (3)

• Adam: A Method for Stochastic Optimization
• Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations
• On the influence of Dice loss function in multi-class organ segmentation of abdominal CT using 3D fully convolutional networks

Cited by in corpus (7)

• SIMUS: an open-source simulator for ultrasound imaging. Part II: comparison with three popular simulators
• Phase Aberration Correction for in vivo Ultrasound Localization Microscopy Using a Spatiotemporal Complex-Valued Neural Network
• Fast and selective super-resolution ultrasound in vivo with sono-switchable nanodroplets
• Towards Transcranial 3D Ultrasound Localization Microscopy of the Nonhuman Primate Brain
• A Tracking prior to Localization workflow for Ultrasound Localization Microscopy
• Enhancing super-resolution ultrasound localisation through multi-frame deconvolution exploiting spatiotemporal coherence
• Optimizing In Vivo Data Acquisition for Robust Clinical Microvascular Imaging Using Ultrasound Localization Microscopy