1.3k citations · 5.6k across the 60 of their papers we have counts for
63 papers
Challenge Results Are Not Reproducible
Annika Reinke, Georg Grab, Lena Maier-Hein
While clinical trials are the state-of-the-art methods to assess the effect of new medication in a comparative manner, benchmarking in the field of medical image analysis is perfor…
Intuitive Surgical SurgToolLoc and SurgVU Challenges Results: 2022-2025
Aneeq Zia, Max Berniker, Rogerio Garcia Nespolo +153
Robotic assisted (RA) surgery promises to transform surgical intervention. Intuitive Surgical is committed to fostering these changes and the machine learning models and algorithms…
Why is the winner the best?
Matthias Eisenmann, Annika Reinke, Vivienn Weru +122
International benchmarking competitions have become fundamental for the comparative performance assessment of image analysis methods. However, little attention has been given to in…
Self-distillation for surgical action recognition
Amine Yamlahi, Thuy Nuong Tran, Patrick Godau +9
Surgical scene understanding is a key prerequisite for contextaware decision support in the operating room. While deep learning-based approaches have already reached or even surpas…
Unsupervised Domain Transfer with Conditional Invertible Neural Networks
Kris K. Dreher, Leonardo Ayala, Melanie Schellenberg +11
Synthetic medical image generation has evolved as a key technique for neural network training and validation. A core challenge, however, remains in the domain gap between simulatio…
Deployment of Image Analysis Algorithms under Prevalence Shifts
Patrick Godau, Piotr Kalinowski, Evangelia Christodoulou +5
Domain gaps are among the most relevant roadblocks in the clinical translation of machine learning (ML)-based solutions for medical image analysis. While current research focuses o…
Semantic segmentation of surgical hyperspectral images under geometric domain shifts
Jan Sellner, Silvia Seidlitz, Alexander Studier-Fischer +5
Robust semantic segmentation of intraoperative image data could pave the way for automatic surgical scene understanding and autonomous robotic surgery. Geometric domain shifts, how…
CholecTriplet2022: Show me a tool and tell me the triplet -- an endoscopic vision challenge for surgical action triplet detection
Chinedu Innocent Nwoye, Tong Yu, Saurav Sharma +46
Formalizing surgical activities as triplets of the used instruments, actions performed, and target anatomies is becoming a gold standard approach for surgical activity modeling. Th…
Objective Surgical Skills Assessment and Tool Localization: Results from the MICCAI 2021 SimSurgSkill Challenge
Aneeq Zia, Kiran Bhattacharyya, Xi Liu +12
Timely and effective feedback within surgical training plays a critical role in developing the skills required to perform safe and efficient surgery. Feedback from expert surgeons,…
Biomedical image analysis competitions: The state of current participation practice
Matthias Eisenmann, Annika Reinke, Vivienn Weru +352
The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known abou…
Sources of performance variability in deep learning-based polyp detection
Thuy Nuong Tran, Tim Adler, Amine Yamlahi +8
Validation metrics are a key prerequisite for the reliable tracking of scientific progress and for deciding on the potential clinical translation of methods. While recent initiativ…
MONAI: An open-source framework for deep learning in healthcare
M. Jorge Cardoso, Wenqi Li, Richard Brown +53
Artificial Intelligence (AI) is having a tremendous impact across most areas of science. Applications of AI in healthcare have the potential to improve our ability to detect, diagn…
Labeling instructions matter in biomedical image analysis
Tim Rädsch, Annika Reinke, Vivienn Weru +7
Biomedical image analysis algorithm validation depends on high-quality annotation of reference datasets, for which labeling instructions are key. Despite their importance, their op…
Metrics reloaded: Recommendations for image analysis validation
Lena Maier-Hein, Annika Reinke, Patrick Godau +71
Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. Particularly in automatic biomedical image analysis, chosen…
Ten years of image analysis and machine learning competitions in dementia
Esther E. Bron, Stefan Klein, Annika Reinke +4
Machine learning methods exploiting multi-parametric biomarkers, especially based on neuroimaging, have huge potential to improve early diagnosis of dementia and to predict which i…
Comparative Validation of Machine Learning Algorithms for Surgical Workflow and Skill Analysis with the HeiChole Benchmark
Martin Wagner, Beat-Peter Müller-Stich, Anna Kisilenko +38
PURPOSE: Surgical workflow and skill analysis are key technologies for the next generation of cognitive surgical assistance systems. These systems could increase the safety of the…
Task Fingerprinting for Meta Learning in Biomedical Image Analysis
Patrick Godau, Lena Maier-Hein
Shortage of annotated data is one of the greatest bottlenecks in biomedical image analysis. Meta learning studies how learning systems can increase in efficiency through experience…
How can we learn (more) from challenges? A statistical approach to driving future algorithm development
Tobias Roß, Pierangela Bruno, Annika Reinke +12
Challenges have become the state-of-the-art approach to benchmark image analysis algorithms in a comparative manner. While the validation on identical data sets was a great step fo…
Machine learning-based analysis of hyperspectral images for automated sepsis diagnosis
Maximilian Dietrich, Silvia Seidlitz, Nicholas Schreck +16
Sepsis is a leading cause of mortality and critical illness worldwide. While robust biomarkers for early diagnosis are still missing, recent work indicates that hyperspectral imagi…
The Medical Segmentation Decathlon
Michela Antonelli, Annika Reinke, Spyridon Bakas +55
International challenges have become the de facto standard for comparative assessment of image analysis algorithms given a specific task. Segmentation is so far the most widely inv…
Video-rate multispectral imaging in laparoscopic surgery: First-in-human application
Leonardo Ayala, Sebastian Wirkert, Anant Vemuri +6
Multispectral and hyperspectral imaging (MSI/HSI) can provide clinically relevant information on morphological and functional tissue properties. Application in the operating room (…
The Federated Tumor Segmentation (FeTS) Challenge
Sarthak Pati, Ujjwal Baid, Maximilian Zenk +29
This manuscript describes the first challenge on Federated Learning, namely the Federated Tumor Segmentation (FeTS) challenge 2021. International challenges have become the standar…
Semantic segmentation of multispectral photoacoustic images using deep learning
Melanie Schellenberg, Kris Dreher, Niklas Holzwarth +7
Photoacoustic (PA) imaging has the potential to revolutionize functional medical imaging in healthcare due to the valuable information on tissue physiology contained in multispectr…
Common Limitations of Image Processing Metrics: A Picture Story
Annika Reinke, Minu D. Tizabi, Carole H. Sudre +90
While the importance of automatic image analysis is continuously increasing, recent meta-research revealed major flaws with respect to algorithm validation. Performance metrics are…