A Partially Learned Algorithm for Joint Photoacoustic Reconstruction and Segmentation

Abstract

In an inhomogeneously illuminated photoacoustic image, important information like vascular geometry is not readily available when only the initial pressure is reconstructed. To obtain the desired information, algorithms for image segmentation are often applied as a post-processing step. In this work, we propose to jointly acquire the photoacoustic reconstruction and segmentation, by modifying a recently developed partially learned algorithm based on a convolutional neural network. We investigate the stability of the algorithm against changes in initial pressures and photoacoustic system settings. These insights are used to develop an algorithm that is robust to input and system settings. Our approach can easily be applied to other imaging modalities and can be modified to perform other high-level tasks different from segmentation. The method is validated on challenging synthetic and experimental photoacoustic tomography data in limited angle and limited view scenarios. It is computationally less expensive than classical iterative methods and enables higher quality reconstructions and segmentations than state-of-the-art learned and non-learned methods.

"copyright 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works."

References in corpus (11)

• Deep Convolutional Neural Network for Inverse Problems in Imaging
• Learned Primal-dual Reconstruction
• Solving ill-posed inverse problems using iterative deep neural networks
• Convex optimization problem prototyping for image reconstruction in computed tomography with the Chambolle-Pock algorithm
• Model based learning for accelerated, limited-view 3D photoacoustic tomography
• Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problems
• Accelerated High-Resolution Photoacoustic Tomography via Compressed Sensing
• On the Adjoint Operator in Photoacoustic Tomography
• Universal inversion formulas for recovering a function from spherical means
• A Framework for Directional and Higher-Order Reconstruction in Photoacoustic Tomography
• Joint Motion Estimation and Segmentation from Undersampled Cardiac MR Image

Cited by in corpus (7)

• Deep learning for biomedical photoacoustic imaging: A review
• Deep Learning in Photoacoustic Tomography: Current approaches and future directions
• Deep learning in biomedical optics
• Task adapted reconstruction for inverse problems
• Improving needle visibility in LED-based photoacoustic imaging using deep learning with semi-synthetic datasets
• Utilizing variational autoencoders in the Bayesian inverse problem of photoacoustic tomography
• Learned Interferometric Imaging for the SPIDER Instrument