activity
20202025
most citedMetrics reloaded: Recommendations for image analysis validation

469 citations · 953 across the 22 of their papers we have counts for

collaborators
Showing cs.CVShow all

14 papers · 1 filter

cs.CV2025★ 2 cited

False Promises in Medical Imaging AI? Assessing Validity of Outperformance Claims

Evangelia Christodoulou, Annika Reinke, Pascaline Andrè +23

Performance comparisons are fundamental in medical imaging Artificial Intelligence (AI) research, often driving claims of superiority based on relative improvements in common perfo…

cs.CV2024★ 1 cited

Xeno-learning: knowledge transfer across species in deep learning-based spectral image analysis

Jan Sellner, Alexander Studier-Fischer, Ahmad Bin Qasim +16

Novel optical imaging techniques, such as hyperspectral imaging (HSI) combined with machine learning-based (ML) analysis, have the potential to revolutionize clinical surgical imag…

cs.CV2024

Confidence intervals uncovered: Are we ready for real-world medical imaging AI?

Evangelia Christodoulou, Annika Reinke, Rola Houhou +19

Medical imaging is spearheading the AI transformation of healthcare. Performance reporting is key to determine which methods should be translated into clinical practice. Frequently…

cs.CV2024★ 2 cited

Quality Assured: Rethinking Annotation Strategies in Imaging AI

Tim Rädsch, Annika Reinke, Vivienn Weru +5

This paper does not describe a novel method. Instead, it studies an essential foundation for reliable benchmarking and ultimately real-world application of AI-based image analysis:…

cs.CV2023★ 2 cited

Application-driven Validation of Posteriors in Inverse Problems

Tim J. Adler, Jan-Hinrich Nölke, Annika Reinke +8

Current deep learning-based solutions for image analysis tasks are commonly incapable of handling problems to which multiple different plausible solutions exist. In response, poste…

cs.CV2023★ 1 cited

Why is the winner the best?

Matthias Eisenmann, Annika Reinke, Vivienn Weru +122

International benchmarking competitions have become fundamental for the comparative performance assessment of image analysis methods. However, little attention has been given to in…

cs.CV2023★ 1 cited

Self-distillation for surgical action recognition

Amine Yamlahi, Thuy Nuong Tran, Patrick Godau +9

Surgical scene understanding is a key prerequisite for contextaware decision support in the operating room. While deep learning-based approaches have already reached or even surpas…

cs.CV2023★ 1 cited

Deployment of Image Analysis Algorithms under Prevalence Shifts

Patrick Godau, Piotr Kalinowski, Evangelia Christodoulou +5

Domain gaps are among the most relevant roadblocks in the clinical translation of machine learning (ML)-based solutions for medical image analysis. While current research focuses o…

cs.CV2023★ 204 cited

Understanding metric-related pitfalls in image analysis validation

Annika Reinke, Minu D. Tizabi, Michael Baumgartner +75

Validation metrics are key for the reliable tracking of scientific progress and for bridging the current chasm between artificial intelligence (AI) research and its translation int…

cs.CV2022★ 17 cited

Biomedical image analysis competitions: The state of current participation practice

Matthias Eisenmann, Annika Reinke, Vivienn Weru +352

The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known abou…

cs.CV2022★ 3 cited

Sources of performance variability in deep learning-based polyp detection

Thuy Nuong Tran, Tim Adler, Amine Yamlahi +8

Validation metrics are a key prerequisite for the reliable tracking of scientific progress and for deciding on the potential clinical translation of methods. While recent initiativ…

cs.CV2022★ 3 cited

Labeling instructions matter in biomedical image analysis

Tim Rädsch, Annika Reinke, Vivienn Weru +7

Biomedical image analysis algorithm validation depends on high-quality annotation of reference datasets, for which labeling instructions are key. Despite their importance, their op…

cs.CV2022★ 469 cited

Metrics reloaded: Recommendations for image analysis validation

Lena Maier-Hein, Annika Reinke, Patrick Godau +71

Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. Particularly in automatic biomedical image analysis, chosen…

cs.CV2020

Heidelberg Colorectal Data Set for Surgical Data Science in the Sensor Operating Room

Lena Maier-Hein, Martin Wagner, Tobias Ross +30

Image-based tracking of medical instruments is an integral part of surgical data science applications. Previous research has addressed the tasks of detecting, segmenting and tracki…