Deep Learning in Photoacoustic Tomography: Current approaches and future directions

Abstract

Biomedical photoacoustic tomography, which can provide high resolution 3D soft tissue images based on the optical absorption, has advanced to the stage at which translation from the laboratory to clinical settings is becoming possible. The need for rapid image formation and the practical restrictions on data acquisition that arise from the constraints of a clinical workflow are presenting new image reconstruction challenges. There are many classical approaches to image reconstruction, but ameliorating the effects of incomplete or imperfect data through the incorporation of accurate priors is challenging and leads to slow algorithms. Recently, the application of Deep Learning, or deep neural networks, to this problem has received a great deal of attention. This paper reviews the literature on learned image reconstruction, summarising the current trends, and explains how these new approaches fit within, and to some extent have arisen from, a framework that encompasses classical reconstruction methods. In particular, it shows how these new techniques can be understood from a Bayesian perspective, providing useful insights. The paper also provides a concise tutorial demonstration of three prototypical approaches to learned image reconstruction. The code and data sets for these demonstrations are available to researchers. It is anticipated that it is in in vivo applications - where data may be sparse, fast imaging critical and priors difficult to construct by hand - that Deep Learning will have the most impact. With this in mind, the paper concludes with some indications of possible future research directions.

References in corpus (44)

• Adam: A Method for Stochastic Optimization
• Deep Learning in Neural Networks: An Overview
• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
• How transferable are features in deep neural networks?
• Deep Convolutional Neural Network for Inverse Problems in Imaging
• Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
• Image reconstruction by domain transform manifold learning
• Learned Primal-dual Reconstruction
• A deep convolutional neural network using directional wavelets for low-dose X-ray CT reconstruction
• Fully Dense UNet for 2D Sparse Photoacoustic Tomography Artifact Removal
• Solving ill-posed inverse problems using iterative deep neural networks
• Stable Architectures for Deep Neural Networks
• Model based learning for accelerated, limited-view 3D photoacoustic tomography
• Thermoacoustic tomography with variable sound speed
• Real-time Cardiovascular MR with Spatio-temporal Artifact Suppression using Deep Learning - Proof of Concept in Congenital Heart Disease
• Double-Stage Delay Multiply and Sum Beamforming Algorithm: Application to Linear-Array Photoacoustic Imaging
• Investigation of iterative image reconstruction in three-dimensional optoacoustic tomography
• A survey of computational frameworks for solving the acoustic inverse problem in three-dimensional photoacoustic computed tomography
• Recurrent Inference Machines for Solving Inverse Problems
• A series solution and a fast algorithm for the inversion of the spherical mean Radon transform
• A Partially Learned Algorithm for Joint Photoacoustic Reconstruction and Segmentation
• Context encoding enables machine learning-based quantitative photoacoustics
• A Two-step-training Deep Learning Framework for Real-time Computational Imaging without Physics Priors
• Reconstruction of a function from its spherical (circular) means with the centers lying on the surface of certain polygons and polyhedra
• Joint Reconstruction of Absorbed Optical Energy Density and Sound Speed Distribution in Photoacoustic Computed Tomography: A numerical Investigation
• Compensating for visibility artefacts in photoacoustic imaging with a deep learning approach providing prediction uncertainties
• Photoacoustic image reconstruction via deep learning
• Invert to Learn to Invert
• A Framework for Directional and Higher-Order Reconstruction in Photoacoustic Tomography
• O-Net: A Convolutional Neural Network for Quantitative Photoacoustic Image Segmentation and Oximetry
• Real-time photoacoustic projection imaging using deep learning
• Learning and correcting non-Gaussian model errors
• Sinogram super-resolution and denoising convolutional neural network (SRCN) for limited data photoacoustic tomography
• Exact Reconstruction Formula for the Spherical Mean Radon Transform on Ellipsoids
• Deep learning versus ${\ell }^1$-minimization for compressed sensing photoacoustic tomography
• iUNets: Fully invertible U-Nets with Learnable Up- and Downsampling
• Y-Net: A Hybrid Deep Learning Reconstruction Framework for Photoacoustic Imaging in vivo
• Neural network augmented wave-equation simulation
• Towards accurate quantitative photoacoustic imaging: learning vascular blood oxygen saturation in 3D
• NETT Regularization for Compressed Sensing Photoacoustic Tomography
• Conditional Normalizing Flows for Low-Dose Computed Tomography Image Reconstruction
• Deep-learning Image Reconstruction for Real-time Photoacoustic System

Cited by in corpus (18)

• Deep learning in biomedical optics
• Deep Learning Methods for Partial Differential Equations and Related Parameter Identification Problems
• Semantic segmentation of multispectral photoacoustic images using deep learning
• Improving needle visibility in LED-based photoacoustic imaging using deep learning with semi-synthetic datasets
• Photoacoustic image synthesis with generative adversarial networks
• Dense Dilated UNet: Deep Learning for 3D Photoacoustic Tomography Image Reconstruction
• Utilizing variational autoencoders in the Bayesian inverse problem of photoacoustic tomography
• Advances in Photoacoustic Imaging Reconstruction and Quantitative Analysis for Biomedical Applications
• Reconstructing initial pressure and speed of sound distributions simultaneously in photoacoustic tomography
• Compressed sensing photoacoustic tomography reduces to compressed sensing for undersampled Fourier measurements
• Single Frame Laser Diode Photoacoustic Imaging: Denoising and Reconstruction
• Combining band-frequency separation and deep neural networks for optoacoustic imaging
• Limited-view Photoacoustic Imaging Reconstruction With Dual Domain Inputs Under Mutual Information Constraint
• On the robustness of model-based algorithms for photoacoustic tomography: comparison between time and frequency domains
• All-optical photoacoustic tomography via beam deflection
• Invariant Representations in Deep Learning for Optoacoustic Imaging
• A Jointed Feature Fusion Framework for Photoacoustic Reconstruction
• Compressed Sensing for Photoacoustic Computed Tomography Using an Untrained Neural Network