A Deep-Learning Approach For Direct Whole-Heart Mesh Reconstruction

Abstract

Automated construction of surface geometries of cardiac structures from volumetric medical images is important for a number of clinical applications. While deep-learning-based approaches have demonstrated promising reconstruction precision, these approaches have mostly focused on voxel-wise segmentation followed by surface reconstruction and post-processing techniques. However, such approaches suffer from a number of limitations including disconnected regions or incorrect surface topology due to erroneous segmentation and stair-case artifacts due to limited segmentation resolution. We propose a novel deep-learning-based approach that directly predicts whole heart surface meshes from volumetric CT and MR image data. Our approach leverages a graph convolutional neural network to predict deformation on mesh vertices from a pre-defined mesh template to reconstruct multiple anatomical structures in a 3D image volume. Our method demonstrated promising performance of generating whole heart reconstructions with as good or better accuracy than prior deep-learning-based methods on both CT and MR data. Furthermore, by deforming a template mesh, our method can generate whole heart geometries with better anatomical consistency and produce high-resolution geometries from lower resolution input image data. Our method was also able to produce temporally consistent surface mesh predictions for heart motion from CT or MR cine sequences, and therefore can potentially be applied for efficiently constructing 4D whole heart dynamics. Our code and pre-trained networks are available at https://github.com/fkong7/MeshDeformNet

References in corpus (7)

• Adam: A Method for Stochastic Optimization
• Automated Design of Deep Learning Methods for Biomedical Image Segmentation
• Geometric deep learning: going beyond Euclidean data
• Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering
• Cascaded V-Net using ROI masks for brain tumor segmentation
• Automatic Cardiac Disease Assessment on cine-MRI via Time-Series Segmentation and Domain Specific Features
• PC-U Net: Learning to Jointly Reconstruct and Segment the Cardiac Walls in 3D from CT Data

Cited by in corpus (8)

• Learning Whole Heart Mesh Generation From Patient Images For Computational Simulations
• Image2Flow: A hybrid image and graph convolutional neural network for rapid patient-specific pulmonary artery segmentation and CFD flow field calculation from 3D cardiac MRI data
• Rapid Estimation of Left Ventricular Contractility with a Physics-Informed Neural Network Inverse Modeling Approach
• SeqSeg: Learning Local Segments for Automatic Vascular Model Construction
• Intelligent Generation of Graphical Game Assets: A Conceptual Framework and Systematic Review of the State of the Art
• Graph Convolutional Neural Networks for Automated Echocardiography View Recognition: A Holistic Approach
• Rapid prediction of cardiac activation in the left ventricle with geometric deep learning: a step towards cardiac resynchronization therapy planning
• Robust Voxelization and Visualization by Improved Tetrahedral Mesh Generation