Simultaneous Recognition and Pose Estimation of Instruments in Minimally Invasive Surgery
arXiv:1710.06668 · doi:10.1007/978-3-319-66185-8_57
Abstract
Detection of surgical instruments plays a key role in ensuring patient safety in minimally invasive surgery. In this paper, we present a novel method for 2D vision-based recognition and pose estimation of surgical instruments that generalizes to different surgical applications. At its core, we propose a novel scene model in order to simultaneously recognize multiple instruments as well as their parts. We use a Convolutional Neural Network architecture to embody our model and show that the cross-entropy loss is well suited to optimize its parameters which can be trained in an end-to-end fashion. An additional advantage of our approach is that instrument detection at test time is achieved while avoiding the need for scale-dependent sliding window evaluation. This allows our approach to be relatively parameter free at test time and shows good performance for both instrument detection and tracking. We show that our approach surpasses state-of-the-art results on in-vivo retinal microsurgery image data, as well as ex-vivo laparoscopic sequences.
arXiv comment8 pages, 2 figures, MICCAI 2017
References in corpus (2)
Cited by in corpus (9)
- 2017 Robotic Instrument Segmentation Challenge
- i3PosNet: Instrument Pose Estimation from X-Ray in temporal bone surgery
- A Kinematic Bottleneck Approach For Pose Regression of Flexible Surgical Instruments directly from Images
- SuPer Deep: A Surgical Perception Framework for Robotic Tissue Manipulation using Deep Learning for Feature Extraction
- Towards Generalizable Surgical Activity Recognition Using Spatial Temporal Graph Convolutional Networks
- A semi-supervised Teacher-Student framework for surgical tool detection and localization
- SD-DefSLAM: Semi-Direct Monocular SLAM for Deformable and Intracorporeal Scenes
- Weakly-Supervised Learning for Tool Localization in Laparoscopic Videos
- Learning Motion Flows for Semi-supervised Instrument Segmentation from Robotic Surgical Video