Compensating for visibility artefacts in photoacoustic imaging with a deep learning approach providing prediction uncertainties

Abstract

Conventional photoacoustic imaging may suffer from the limited view and bandwidth of ultrasound transducers. A deep learning approach is proposed to handle these problems and is demonstrated both in simulations and in experiments on a multi-scale model of leaf skeleton. We employed an experimental approach to build the training and the test sets using photographs of the samples as ground truth images. Reconstructions produced by the neural network show a greatly improved image quality as compared to conventional approaches. In addition, this work aimed at quantifying the reliability of the neural network predictions. To achieve this, the dropout Monte-Carlo procedure is applied to estimate a pixel-wise degree of confidence on each predicted picture. Last, we address the possibility to use transfer learning with simulated data in order to drastically limit the size of the experimental dataset.

main text 10 pages + Supplementary materials 6 pages

References in corpus (14)

• Adam: A Method for Stochastic Optimization
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Fully Convolutional Networks for Semantic Segmentation
• Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning
• Deep Convolutional Neural Network for Inverse Problems in Imaging
• ResUNet-a: a deep learning framework for semantic segmentation of remotely sensed data
• Fully Dense UNet for 2D Sparse Photoacoustic Tomography Artifact Removal
• Model based learning for accelerated, limited-view 3D photoacoustic tomography
• Reliable deep-learning-based phase imaging with uncertainty quantification
• Context encoding enables machine learning-based quantitative photoacoustics
• Photoacoustic imaging beyond the acoustic diffraction-limit with dynamic speckle illumination and sparse joint support recovery
• Photoacoustic fluctuation imaging: theory and application to blood flow imaging
• Real-time photoacoustic projection imaging using deep learning
• Towards accurate quantitative photoacoustic imaging: learning vascular blood oxygen saturation in 3D

Cited by in corpus (4)

• Deep Learning in Photoacoustic Tomography: Current approaches and future directions
• Deep learning for photoacoustic imaging: a survey
• Utilizing variational autoencoders in the Bayesian inverse problem of photoacoustic tomography
• Invariant Representations in Deep Learning for Optoacoustic Imaging