Surgical Data Science: Enabling Next-Generation Surgery

Abstract

This paper introduces Surgical Data Science as an emerging scientific discipline. Key perspectives are based on discussions during an intensive two-day international interactive workshop that brought together leading researchers working in the related field of computer and robot assisted interventions. Our consensus opinion is that increasing access to large amounts of complex data, at scale, throughout the patient care process, complemented by advances in data science and machine learning techniques, has set the stage for a new generation of analytics that will support decision-making and quality improvement in interventional medicine. In this article, we provide a consensus definition for Surgical Data Science, identify associated challenges and opportunities and provide a roadmap for advancing the field.

arXiv comment10 pages, 2 figures, White paper corresponding to http://www.surgical-data-science.org/workshop2016

Cited by in corpus (43)

• TeCNO: Surgical Phase Recognition with Multi-Stage Temporal Convolutional Networks
• Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videos
• Accelerating Surgical Robotics Research: A Review of 10 Years With the da Vinci Research Kit
• Gesture Recognition in Robotic Surgery: a Review
• CAI4CAI: The Rise of Contextual Artificial Intelligence in Computer Assisted Interventions
• Evaluating surgical skills from kinematic data using convolutional neural networks
• Accurate and interpretable evaluation of surgical skills from kinematic data using fully convolutional neural networks
• Robust deep learning-based semantic organ segmentation in hyperspectral images
• CholecTriplet2021: A benchmark challenge for surgical action triplet recognition
• Federated Cycling (FedCy): Semi-supervised Federated Learning of Surgical Phases
• Uncertainty-Aware Organ Classification for Surgical Data Science Applications in Laparoscopy
• Image Compositing for Segmentation of Surgical Tools without Manual Annotations
• Towards Holistic Surgical Scene Understanding
• Rendezvous in Time: An Attention-based Temporal Fusion approach for Surgical Triplet Recognition
• Human Pose Estimation on Privacy-Preserving Low-Resolution Depth Images
• A Kinematic Bottleneck Approach For Pose Regression of Flexible Surgical Instruments directly from Images
• SimCol3D -- 3D Reconstruction during Colonoscopy Challenge
• The Endoscapes Dataset for Surgical Scene Segmentation, Object Detection, and Critical View of Safety Assessment: Official Splits and Benchmark
• On the Pitfalls of Batch Normalization for End-to-End Video Learning: A Study on Surgical Workflow Analysis
• Encoding Surgical Videos as Latent Spatiotemporal Graphs for Object and Anatomy-Driven Reasoning
• Weakly Supervised Temporal Convolutional Networks for Fine-grained Surgical Activity Recognition
• Surgeons Awareness, Expectations, and Involvement with Artificial Intelligence: a Survey Pre and Post the GPT Era
• Surgical Visual Domain Adaptation: Results from the MICCAI 2020 SurgVisDom Challenge
• Trans-SVNet: Accurate Phase Recognition from Surgical Videos via Hybrid Embedding Aggregation Transformer
• Think Step by Step: Chain-of-Gesture Prompting for Error Detection in Robotic Surgical Videos
• Face Detection in the Operating Room: Comparison of State-of-the-art Methods and a Self-supervised Approach
• Multi-Task Temporal Convolutional Networks for Joint Recognition of Surgical Phases and Steps in Gastric Bypass Procedures
• SEDMamba: Enhancing Selective State Space Modelling with Bottleneck Mechanism and Fine-to-Coarse Temporal Fusion for Efficient Error Detection in Robot-Assisted Surgery
• Reducing Annotating Load: Active Learning with Synthetic Images in Surgical Instrument Segmentation
• Surgical Phase and Instrument Recognition: How to identify appropriate Dataset Splits
• Relational Graph Learning on Visual and Kinematics Embeddings for Accurate Gesture Recognition in Robotic Surgery
• Self-supervision on Unlabelled OR Data for Multi-person 2D/3D Human Pose Estimation
• Recognition of Instrument-Tissue Interactions in Endoscopic Videos via Action Triplets
• Interpretable Fully Convolutional Classification of Intrapapillary Capillary Loops for Real-Time Detection of Early Squamous Neoplasia
• "Train one, Classify one, Teach one" -- Cross-surgery transfer learning for surgical step recognition
• Temporal Memory Relation Network for Workflow Recognition from Surgical Video
• Learning dissection trajectories from expert surgical videos via imitation learning with equivariant diffusion
• Multimodal Semantic Scene Graphs for Holistic Modeling of Surgical Procedures
• PoCaPNet: A Novel Approach for Surgical Phase Recognition Using Speech and X-Ray Images
• Latent Graph Representations for Critical View of Safety Assessment
• FaceOff: Anonymizing Videos in the Operating Rooms
• Symmetric Dilated Convolution for Surgical Gesture Recognition
• AutoSNAP: Automatically Learning Neural Architectures for Instrument Pose Estimation