Comparative evaluation of instrument segmentation and tracking methods in minimally invasive surgery
arXiv:1805.02475
Abstract
Intraoperative segmentation and tracking of minimally invasive instruments is a prerequisite for computer- and robotic-assisted surgery. Since additional hardware like tracking systems or the robot encoders are cumbersome and lack accuracy, surgical vision is evolving as promising techniques to segment and track the instruments using only the endoscopic images. However, what is missing so far are common image data sets for consistent evaluation and benchmarking of algorithms against each other. The paper presents a comparative validation study of different vision-based methods for instrument segmentation and tracking in the context of robotic as well as conventional laparoscopic surgery. The contribution of the paper is twofold: we introduce a comprehensive validation data set that was provided to the study participants and present the results of the comparative validation study. Based on the results of the validation study, we arrive at the conclusion that modern deep learning approaches outperform other methods in instrument segmentation tasks, but the results are still not perfect. Furthermore, we show that merging results from different methods actually significantly increases accuracy in comparison to the best stand-alone method. On the other hand, the results of the instrument tracking task show that this is still an open challenge, especially during challenging scenarios in conventional laparoscopic surgery.
References in corpus (2)
Cited by in corpus (9)
- Accelerating Surgical Robotics Research: A Review of 10 Years With the da Vinci Research Kit
- Methods and datasets for segmentation of minimally invasive surgical instruments in endoscopic images and videos: A review of the state of the art
- Robust Medical Instrument Segmentation Challenge 2019
- MATIS: Masked-Attention Transformers for Surgical Instrument Segmentation
- Assessing YOLACT++ for real time and robust instance segmentation of medical instruments in endoscopic procedures
- CholecInstanceSeg: A Tool Instance Segmentation Dataset for Laparoscopic Surgery
- Deep Homography Estimation in Dynamic Surgical Scenes for Laparoscopic Camera Motion Extraction
- LapSeg3D: Weakly Supervised Semantic Segmentation of Point Clouds Representing Laparoscopic Scenes
- How can we learn (more) from challenges? A statistical approach to driving future algorithm development