118 citations · 436 across the 34 of their papers we have counts for
34 papers
Understanding Multimodality in Generative Behavioral Cloning
Lorenzo Mazza, Massimiliano Datres, Ariel Rodriguez +3
Behavioral cloning becomes challenging when the same observation admits several valid actions. We study how generative behavioral-cloning policies represent such multimodal expert…
OSS: Open Suturing Skills Vision-Based Assessment Challenge 2024-2025
Hanna Hoffmann, Setareh Bady, Claas de Boer +54
Achieving high levels of surgical skill through effective training is essential for optimal patient outcomes. Automated, data-driven skill assessment holds significant potential to…
Open-H-Embodiment: A Large-Scale Dataset for Enabling Foundation Models in Medical Robotics
Open-H-Embodiment Consortium, :, Nigel Nelson +213
Autonomous medical robots hold promise to improve patient outcomes, reduce provider workload, democratize access to care, and enable superhuman precision. However, autonomous medic…
An Open-Source Robotics Research Platform for Autonomous Laparoscopic Surgery
Ariel Rodriguez, Lorenzo Mazza, Martin Lelis +4
Autonomous robot-assisted surgery demands reliable, high-precision platforms that strictly adhere to the safety and kinematic constraints of minimally invasive procedures. Existing…
LAR-MoE: Latent-Aligned Routing for Mixture of Experts in Robotic Imitation Learning
Ariel Rodriguez, Chenpan Li, Lorenzo Mazza +5
Imitation learning enables robots to acquire manipulation skills from demonstrations, yet deploying a policy across tasks with heterogeneous dynamics remains challenging, as models…
A benchmark for video-based laparoscopic skill analysis and assessment
Isabel Funke, Sebastian Bodenstedt, Felix von Bechtolsheim +7
Laparoscopic surgery is a complex surgical technique that requires extensive training. Recent advances in deep learning have shown promise in supporting this training by enabling a…
Supervised Mixture-of-Experts for Surgical Grasping and Retraction
Lorenzo Mazza, Ariel Rodriguez, Rayan Younis +6
Imitation learning has achieved remarkable success in robotic manipulation, yet its application to surgical robotics remains challenging due to data scarcity, constrained workspace…
XiCAD: Camera Activation Detection in the Da Vinci Xi User Interface
Alexander C. Jenke, Gregor Just, Claas de Boer +3
Purpose: Robot-assisted minimally invasive surgery relies on endoscopic video as the sole intraoperative visual feedback. The DaVinci Xi system overlays a graphical user interface…
Current validation practice undermines surgical AI development
Annika Reinke, Ziying O. Li, Minu D. Tizabi +98
Surgical data science (SDS) is rapidly advancing, yet clinical adoption of artificial intelligence (AI) in surgery remains limited, with inadequate validation as an important contr…
Federated Learning for Surgical Vision in Appendicitis Classification: Results of the FedSurg EndoVis 2024 Challenge
Max Kirchner, Hanna Hoffmann, Alexander C. Jenke +16
Developing generalizable surgical AI requires multi-institutional data, yet privacy constraints preclude direct data sharing, making Federated Learning (FL) a natural candidate. It…
Federated EndoViT: Pretraining Vision Transformers via Federated Learning on Endoscopic Image Collections
Max Kirchner, Alexander C. Jenke, Sebastian Bodenstedt +5
Purpose: Data privacy regulations hinder the creation of generalizable foundation models (FMs) for surgery by preventing multi-institutional data aggregation. This study investigat…
One model to use them all: Training a segmentation model with complementary datasets
Alexander C. Jenke, Sebastian Bodenstedt, Fiona R. Kolbinger +3
Understanding a surgical scene is crucial for computer-assisted surgery systems to provide any intelligent assistance functionality. One way of achieving this scene understanding i…
SAR-RARP50: Segmentation of surgical instrumentation and Action Recognition on Robot-Assisted Radical Prostatectomy Challenge
Dimitrios Psychogyios, Emanuele Colleoni, Beatrice Van Amsterdam +47
Surgical tool segmentation and action recognition are fundamental building blocks in many computer-assisted intervention applications, ranging from surgical skills assessment to de…
Graph data modelling for outcome prediction in oropharyngeal cancer patients
Nithya Bhasker, Stefan Leger, Alexander Zwanenburg +4
Graph neural networks (GNNs) are becoming increasingly popular in the medical domain for the tasks of disease classification and outcome prediction. Since patient data is not readi…
Non-rigid Point Cloud Registration for Middle Ear Diagnostics with Endoscopic Optical Coherence Tomography
Peng Liu, Jonas Golde, Joseph Morgenstern +7
Purpose: Middle ear infection is the most prevalent inflammatory disease, especially among the pediatric population. Current diagnostic methods are subjective and depend on visual…
Why is the winner the best?
Matthias Eisenmann, Annika Reinke, Vivienn Weru +122
International benchmarking competitions have become fundamental for the comparative performance assessment of image analysis methods. However, little attention has been given to in…
Biomedical image analysis competitions: The state of current participation practice
Matthias Eisenmann, Annika Reinke, Vivienn Weru +352
The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known abou…
CholecTriplet2021: A benchmark challenge for surgical action triplet recognition
Chinedu Innocent Nwoye, Deepak Alapatt, Tong Yu +59
Context-aware decision support in the operating room can foster surgical safety and efficiency by leveraging real-time feedback from surgical workflow analysis. Most existing works…
Comparative Validation of Machine Learning Algorithms for Surgical Workflow and Skill Analysis with the HeiChole Benchmark
Martin Wagner, Beat-Peter Müller-Stich, Anna Kisilenko +38
PURPOSE: Surgical workflow and skill analysis are key technologies for the next generation of cognitive surgical assistance systems. These systems could increase the safety of the…
Rethinking Anticipation Tasks: Uncertainty-aware Anticipation of Sparse Surgical Instrument Usage for Context-aware Assistance
Dominik Rivoir, Sebastian Bodenstedt, Isabel Funke +4
Intra-operative anticipation of instrument usage is a necessary component for context-aware assistance in surgery, e.g. for instrument preparation or semi-automation of robotic tas…
Heidelberg Colorectal Data Set for Surgical Data Science in the Sensor Operating Room
Lena Maier-Hein, Martin Wagner, Tobias Ross +30
Image-based tracking of medical instruments is an integral part of surgical data science applications. Previous research has addressed the tasks of detecting, segmenting and tracki…
Robust Medical Instrument Segmentation Challenge 2019
Tobias Ross, Annika Reinke, Peter M. Full +47
Intraoperative tracking of laparoscopic instruments is often a prerequisite for computer and robotic-assisted interventions. While numerous methods for detecting, segmenting and tr…
Unsupervised Temporal Video Segmentation as an Auxiliary Task for Predicting the Remaining Surgery Duration
Dominik Rivoir, Sebastian Bodenstedt, Felix von Bechtolsheim +3
Estimating the remaining surgery duration (RSD) during surgical procedures can be useful for OR planning and anesthesia dose estimation. With the recent success of deep learning-ba…
2018 Robotic Scene Segmentation Challenge
Max Allan, Satoshi Kondo, Sebastian Bodenstedt +38
In 2015 we began a sub-challenge at the EndoVis workshop at MICCAI in Munich using endoscope images of ex-vivo tissue with automatically generated annotations from robot forward ki…