MedShapeNet -- A Large-Scale Dataset of 3D Medical Shapes for Computer Vision

Abstract

Prior to the deep learning era, shape was commonly used to describe the objects. Nowadays, state-of-the-art (SOTA) algorithms in medical imaging are predominantly diverging from computer vision, where voxel grids, meshes, point clouds, and implicit surface models are used. This is seen from numerous shape-related publications in premier vision conferences as well as the growing popularity of ShapeNet (about 51,300 models) and Princeton ModelNet (127,915 models). For the medical domain, we present a large collection of anatomical shapes (e.g., bones, organs, vessels) and 3D models of surgical instrument, called MedShapeNet, created to facilitate the translation of data-driven vision algorithms to medical applications and to adapt SOTA vision algorithms to medical problems. As a unique feature, we directly model the majority of shapes on the imaging data of real patients. As of today, MedShapeNet includes 23 dataset with more than 100,000 shapes that are paired with annotations (ground truth). Our data is freely accessible via a web interface and a Python application programming interface (API) and can be used for discriminative, reconstructive, and variational benchmarks as well as various applications in virtual, augmented, or mixed reality, and 3D printing. Exemplary, we present use cases in the fields of classification of brain tumors, facial and skull reconstructions, multi-class anatomy completion, education, and 3D printing. In future, we will extend the data and improve the interfaces. The project pages are: https://medshapenet.ikim.nrw/ and https://github.com/Jianningli/medshapenet-feedback

16 pages

References in corpus (10)

• TotalSegmentator: robust segmentation of 104 anatomical structures in CT images
• MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classification
• Medical Deep Learning -- A systematic Meta-Review
• AMOS: A Large-Scale Abdominal Multi-Organ Benchmark for Versatile Medical Image Segmentation
• ISLES 2022: A multi-center magnetic resonance imaging stroke lesion segmentation dataset
• Point Cloud Diffusion Models for Automatic Implant Generation
• High-Resolution Cranial Defect Reconstruction by Iterative, Low-Resolution, Point Cloud Completion Transformers
• Multisensory extended reality applications offer benefits for volumetric biomedical image analysis in research and medicine
• Body Fat Estimation from Surface Meshes using Graph Neural Networks
• BlendFields: Few-Shot Example-Driven Facial Modeling

Cited by in corpus (4)

• A Survey of Medical Point Cloud Shape Learning: Registration, Reconstruction and Variation
• The Anatomy of Coronary Risk: How Artery Geometry Shapes Coronary Artery Disease through Blood Flow Haemodynamics -- Latest Methods, Insights and Clinical Implications
• Med-PU: Point Cloud Upsampling for High-Fidelity 3D Medical Shape Reconstruction
• Training-free Detection and 6D Pose Estimation of Unseen Surgical Instruments