Reconstructing Sinus Anatomy from Endoscopic Video -- Towards a Radiation-free Approach for Quantitative Longitudinal Assessment

Abstract

Reconstructing accurate 3D surface models of sinus anatomy directly from an endoscopic video is a promising avenue for cross-sectional and longitudinal analysis to better understand the relationship between sinus anatomy and surgical outcomes. We present a patient-specific, learning-based method for 3D reconstruction of sinus surface anatomy directly and only from endoscopic videos. We demonstrate the effectiveness and accuracy of our method on in and ex vivo data where we compare to sparse reconstructions from Structure from Motion, dense reconstruction from COLMAP, and ground truth anatomy from CT. Our textured reconstructions are watertight and enable measurement of clinically relevant parameters in good agreement with CT. The source code is available at https://github.com/lppllppl920/DenseReconstruction-Pytorch.

arXiv commentAccepted to MICCAI 2020

References in corpus (4)

• Recurrent Neural Network for (Un-)supervised Learning of Monocular VideoVisual Odometry and Depth
• Sparse-then-Dense Alignment based 3D Map Reconstruction Method for Endoscopic Capsule Robots
• SLAM Endoscopy enhanced by adversarial depth prediction
• Extremely Dense Point Correspondences using a Learned Feature Descriptor