CHeart: A Conditional Spatio-Temporal Generative Model for Cardiac Anatomy
arXiv:2301.13098 · doi:10.1109/TMI.2023.3331982
Abstract
Two key questions in cardiac image analysis are to assess the anatomy and motion of the heart from images; and to understand how they are associated with non-imaging clinical factors such as gender, age and diseases. While the first question can often be addressed by image segmentation and motion tracking algorithms, our capability to model and to answer the second question is still limited. In this work, we propose a novel conditional generative model to describe the 4D spatio-temporal anatomy of the heart and its interaction with non-imaging clinical factors. The clinical factors are integrated as the conditions of the generative modelling, which allows us to investigate how these factors influence the cardiac anatomy. We evaluate the model performance in mainly two tasks, anatomical sequence completion and sequence generation. The model achieves a high performance in anatomical sequence completion, comparable to or outperforming other state-of-the-art generative models. In terms of sequence generation, given clinical conditions, the model can generate realistic synthetic 4D sequential anatomies that share similar distributions with the real data.
Accepted by IEEE Transactions on Medical Imaging
References in corpus (8)
- Sequence to Sequence Learning with Neural Networks
- Conditional Generative Adversarial Nets
- GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models
- SynthSeg: Segmentation of brain MRI scans of any contrast and resolution without retraining
- Make-A-Video: Text-to-Video Generation without Text-Video Data
- DECAF: Generating Fair Synthetic Data Using Causally-Aware Generative Networks
- Predicting Video with VQVAE
- Beyond Privacy: Navigating the Opportunities and Challenges of Synthetic Data
Cited by in corpus (5)
- Probing the Limits and Capabilities of Diffusion Models for the Anatomic Editing of Digital Twins
- 3D Brain and Heart Volume Generative Models: A Survey
- A personalized time-resolved 3D mesh generative model for unveiling normal heart dynamics
- SDF4CHD: Generative Modeling of Cardiac Anatomies with Congenital Heart Defects
- Synthetic Data Generation for 3D Myocardium Deformation Analysis