Solving Inverse Problems in Medical Imaging with Score-Based Generative Models

Abstract

Reconstructing medical images from partial measurements is an important inverse problem in Computed Tomography (CT) and Magnetic Resonance Imaging (MRI). Existing solutions based on machine learning typically train a model to directly map measurements to medical images, leveraging a training dataset of paired images and measurements. These measurements are typically synthesized from images using a fixed physical model of the measurement process, which hinders the generalization capability of models to unknown measurement processes. To address this issue, we propose a fully unsupervised technique for inverse problem solving, leveraging the recently introduced score-based generative models. Specifically, we first train a score-based generative model on medical images to capture their prior distribution. Given measurements and a physical model of the measurement process at test time, we introduce a sampling method to reconstruct an image consistent with both the prior and the observed measurements. Our method does not assume a fixed measurement process during training, and can thus be flexibly adapted to different measurement processes at test time. Empirically, we observe comparable or better performance to supervised learning techniques in several medical imaging tasks in CT and MRI, while demonstrating significantly better generalization to unknown measurement processes.

Published at ICLR 2022

Cited by in corpus (17)

• Diffusion Models in Vision: A Survey
• Adaptive Diffusion Priors for Accelerated MRI Reconstruction
• Solving 3D Inverse Problems using Pre-trained 2D Diffusion Models
• Artifact Reduction in 3D and 4D Cone-beam Computed Tomography Images with Deep Learning -- A Review
• PatchNR: Learning from Very Few Images by Patch Normalizing Flow Regularization
• Conditional score-based diffusion models for solving inverse problems in mechanics
• Conditioning and Sampling in Variational Diffusion Models for Speech Super-Resolution
• Score-Based Generative Models for PET Image Reconstruction
• 3DGR-CT: Sparse-View CT Reconstruction with a 3D Gaussian Representation
• Solving Inverse Problems with Score-Based Generative Priors learned from Noisy Data
• Probing the Limits and Capabilities of Diffusion Models for the Anatomic Editing of Digital Twins
• Score-Based Diffusion Models for Photoacoustic Tomography Image Reconstruction
• Back-Projection Diffusion: Solving the Wideband Inverse Scattering Problem with Diffusion Models
• Rotational Augmented Noise2Inverse for Low-dose Computed Tomography Reconstruction
• A Regularized Conditional GAN for Posterior Sampling in Image Recovery Problems
• Monte Carlo guided Diffusion for Bayesian linear inverse problems
• Adapt and Diffuse: Sample-adaptive Reconstruction via Latent Diffusion Models