Semantic segmentation of multispectral photoacoustic images using deep learning

Abstract

Photoacoustic (PA) imaging has the potential to revolutionize functional medical imaging in healthcare due to the valuable information on tissue physiology contained in multispectral photoacoustic measurements. Clinical translation of the technology requires conversion of the high-dimensional acquired data into clinically relevant and interpretable information. In this work, we present a deep learning-based approach to semantic segmentation of multispectral photoacoustic images to facilitate image interpretability. Manually annotated photoacoustic {and ultrasound} imaging data are used as reference and enable the training of a deep learning-based segmentation algorithm in a supervised manner. Based on a validation study with experimentally acquired data from 16 healthy human volunteers, we show that automatic tissue segmentation can be used to create powerful analyses and visualizations of multispectral photoacoustic images. Due to the intuitive representation of high-dimensional information, such a preprocessing algorithm could be a valuable means to facilitate the clinical translation of photoacoustic imaging.

arXiv comment8 pages, 7 figures, 3 tables

References in corpus (10)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Automated Design of Deep Learning Methods for Biomedical Image Segmentation
• The Medical Segmentation Decathlon
• Eigenspectra optoacoustic tomography achieves quantitative blood oxygenation imaging deep in tissues
• Deep learning for biomedical photoacoustic imaging: A review
• Deep Learning in Photoacoustic Tomography: Current approaches and future directions
• Common Limitations of Image Processing Metrics: A Picture Story
• Estimation of blood oxygenation with learned spectral decoloring for quantitative photoacoustic imaging (LSD-qPAI)
• O-Net: A Convolutional Neural Network for Quantitative Photoacoustic Image Segmentation and Oximetry
• Hölder stability of quantitative photoacoustic tomography based on partial data

Cited by in corpus (3)

• Photoacoustic image synthesis with generative adversarial networks
• Machine learning-based analysis of hyperspectral images for automated sepsis diagnosis
• Unsupervised Domain Transfer with Conditional Invertible Neural Networks