Enhancing joint reconstruction and segmentation with non-convex Bregman iteration

Abstract

All imaging modalities such as computed tomography (CT), emission tomography and magnetic resonance imaging (MRI) require a reconstruction approach to produce an image. A common image processing task for applications that utilise those modalities is image segmentation, typically performed posterior to the reconstruction. We explore a new approach that combines reconstruction and segmentation in a unified framework. We derive a variational model that consists of a total variation regularised reconstruction from undersampled measurements and a Chan-Vese based segmentation. We extend the variational regularisation scheme to a Bregman iteration framework to improve the reconstruction and therefore the segmentation. We develop a novel alternating minimisation scheme that solves the non-convex optimisation problem with provable convergence guarantees. Our results for synthetic and real data show that both reconstruction and segmentation are improved compared to the classical sequential approach.

References in corpus (4)

• Multi-Contrast MRI Reconstruction with Structure-Guided Total Variation
• Consistencies and rates of convergence of jump-penalized least squares estimators
• Joint Image Reconstruction and Segmentation Using the Potts Model
• Simultaneous Reconstruction and Segmentation for Dynamic SPECT Imaging

Cited by in corpus (6)

• A Joint Inversion-Segmentation approach to Assisted Seismic Interpretation
• Classification and image processing with a semi-discrete scheme for fidelity forced Allen--Cahn on graphs
• Seeing through the CO2 plume: joint inversion-segmentation of the Sleipner 4D Seismic Dataset
• Synergistic Multi-spectral CT Reconstruction with Directional Total Variation
• Joint reconstruction-segmentation on graphs
• Regularized Compression of MRI Data: Modular Optimization of Joint Reconstruction and Coding