1.3k citations · 5.6k across the 60 of their papers we have counts for
30 papers · 1 filter
Challenge Results Are Not Reproducible
Annika Reinke, Georg Grab, Lena Maier-Hein
While clinical trials are the state-of-the-art methods to assess the effect of new medication in a comparative manner, benchmarking in the field of medical image analysis is perfor…
Intuitive Surgical SurgToolLoc and SurgVU Challenges Results: 2022-2025
Aneeq Zia, Max Berniker, Rogerio Garcia Nespolo +153
Robotic assisted (RA) surgery promises to transform surgical intervention. Intuitive Surgical is committed to fostering these changes and the machine learning models and algorithms…
Why is the winner the best?
Matthias Eisenmann, Annika Reinke, Vivienn Weru +122
International benchmarking competitions have become fundamental for the comparative performance assessment of image analysis methods. However, little attention has been given to in…
Self-distillation for surgical action recognition
Amine Yamlahi, Thuy Nuong Tran, Patrick Godau +9
Surgical scene understanding is a key prerequisite for contextaware decision support in the operating room. While deep learning-based approaches have already reached or even surpas…
Deployment of Image Analysis Algorithms under Prevalence Shifts
Patrick Godau, Piotr Kalinowski, Evangelia Christodoulou +5
Domain gaps are among the most relevant roadblocks in the clinical translation of machine learning (ML)-based solutions for medical image analysis. While current research focuses o…
Objective Surgical Skills Assessment and Tool Localization: Results from the MICCAI 2021 SimSurgSkill Challenge
Aneeq Zia, Kiran Bhattacharyya, Xi Liu +12
Timely and effective feedback within surgical training plays a critical role in developing the skills required to perform safe and efficient surgery. Feedback from expert surgeons,…
Biomedical image analysis competitions: The state of current participation practice
Matthias Eisenmann, Annika Reinke, Vivienn Weru +352
The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known abou…
Sources of performance variability in deep learning-based polyp detection
Thuy Nuong Tran, Tim Adler, Amine Yamlahi +8
Validation metrics are a key prerequisite for the reliable tracking of scientific progress and for deciding on the potential clinical translation of methods. While recent initiativ…
Labeling instructions matter in biomedical image analysis
Tim Rädsch, Annika Reinke, Vivienn Weru +7
Biomedical image analysis algorithm validation depends on high-quality annotation of reference datasets, for which labeling instructions are key. Despite their importance, their op…
Metrics reloaded: Recommendations for image analysis validation
Lena Maier-Hein, Annika Reinke, Patrick Godau +71
Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. Particularly in automatic biomedical image analysis, chosen…
Task Fingerprinting for Meta Learning in Biomedical Image Analysis
Patrick Godau, Lena Maier-Hein
Shortage of annotated data is one of the greatest bottlenecks in biomedical image analysis. Meta learning studies how learning systems can increase in efficiency through experience…
How can we learn (more) from challenges? A statistical approach to driving future algorithm development
Tobias Roß, Pierangela Bruno, Annika Reinke +12
Challenges have become the state-of-the-art approach to benchmark image analysis algorithms in a comparative manner. While the validation on identical data sets was a great step fo…
Surgical Visual Domain Adaptation: Results from the MICCAI 2020 SurgVisDom Challenge
Aneeq Zia, Kiran Bhattacharyya, Xi Liu +10
Surgical data science is revolutionizing minimally invasive surgery by enabling context-aware applications. However, many challenges exist around surgical data (and health data, mo…
Stereo Correspondence and Reconstruction of Endoscopic Data Challenge
Max Allan, Jonathan Mcleod, Congcong Wang +21
The stereo correspondence and reconstruction of endoscopic data sub-challenge was organized during the Endovis challenge at MICCAI 2019 in Shenzhen, China. The task was to perform…
SERV-CT: A disparity dataset from CT for validation of endoscopic 3D reconstruction
P. J. "Eddie'' Edwards, Dimitris Psychogyios, Stefanie Speidel +2
In computer vision, reference datasets have been highly successful in promoting algorithmic development in stereo reconstruction. Surgical scenes gives rise to specific problems, i…
Representing Ambiguity in Registration Problems with Conditional Invertible Neural Networks
Darya Trofimova, Tim Adler, Lisa Kausch +5
Image registration is the basis for many applications in the fields of medical image computing and computer assisted interventions. One example is the registration of 2D X-ray imag…
Heidelberg Colorectal Data Set for Surgical Data Science in the Sensor Operating Room
Lena Maier-Hein, Martin Wagner, Tobias Ross +30
Image-based tracking of medical instruments is an integral part of surgical data science applications. Previous research has addressed the tasks of detecting, segmenting and tracki…
Robust Medical Instrument Segmentation Challenge 2019
Tobias Ross, Annika Reinke, Peter M. Full +47
Intraoperative tracking of laparoscopic instruments is often a prerequisite for computer and robotic-assisted interventions. While numerous methods for detecting, segmenting and tr…
2018 Robotic Scene Segmentation Challenge
Max Allan, Satoshi Kondo, Sebastian Bodenstedt +38
In 2015 we began a sub-challenge at the EndoVis workshop at MICCAI in Munich using endoscope images of ex-vivo tissue with automatically generated annotations from robot forward ki…
Methods and open-source toolkit for analyzing and visualizing challenge results
Manuel Wiesenfarth, Annika Reinke, Bennett A. Landman +3
Biomedical challenges have become the de facto standard for benchmarking biomedical image analysis algorithms. While the number of challenges is steadily increasing, surprisingly l…
BIAS: Transparent reporting of biomedical image analysis challenges
Lena Maier-Hein, Annika Reinke, Michal Kozubek +11
The number of biomedical image analysis challenges organized per year is steadily increasing. These international competitions have the purpose of benchmarking algorithms on common…
A large annotated medical image dataset for the development and evaluation of segmentation algorithms
Amber L. Simpson, Michela Antonelli, Spyridon Bakas +21
Semantic segmentation of medical images aims to associate a pixel with a label in a medical image without human initialization. The success of semantic segmentation algorithms is c…
2017 Robotic Instrument Segmentation Challenge
Max Allan, Alex Shvets, Thomas Kurmann +16
In mainstream computer vision and machine learning, public datasets such as ImageNet, COCO and KITTI have helped drive enormous improvements by enabling researchers to understand t…
Monte-Carlo Sampling applied to Multiple Instance Learning for Histological Image Classification
Marc Combalia, Veronica Vilaplana
We propose a patch sampling strategy based on a sequential Monte-Carlo method for high resolution image classification in the context of Multiple Instance Learning. When compared w…