activity
20212026
most citedMetrics reloaded: Recommendations for image analysis validation

469 citations · 757 across the 20 of their papers we have counts for

collaborators

20 papers

cs.CV2026

Towards Global AI-Driven Cervical Cancer Screening

Thuy Nuong Tran, Ömer Sümer, Evangelia Christodoulou +15

The global elimination of cervical cancer is a key public health goal set by the World Health Organization (WHO), with screening programs reducing mortality by up to 80%. However,…

cs.CV2026

A multi-center analysis of deep learning methods for video polyp detection and segmentation

Noha Ghatwary, Pedro Chavarias Solano, Mohamed Ramzy Ibrahim +24

Colonic polyps are well-recognized precursors to colorectal cancer (CRC), typically detected during colonoscopy. However, the variability in appearance, location, and size of these…

cs.CV2026★ 2 cited

Performance uncertainty in medical image analysis: a large-scale investigation of confidence intervals

Pascaline André, Charles Heitz, Evangelia Christodoulou +10

Performance uncertainty quantification is essential for reliable validation and eventual clinical translation of medical imaging artificial intelligence (AI). Confidence intervals…

q-bio.OT2025★ 1 cited

Current validation practice undermines surgical AI development

Annika Reinke, Ziying O. Li, Minu D. Tizabi +98

Surgical data science (SDS) is rapidly advancing, yet clinical adoption of artificial intelligence (AI) in surgery remains limited, with inadequate validation as an important contr…

cs.LG2025

Benchmarking and Evaluation of AI Models in Biology: Outcomes and Recommendations from the CZI Virtual Cells Workshop

Elizabeth Fahsbender, Alma Andersson, Jeremy Ash +32

Artificial intelligence holds immense promise for transforming biology, yet a lack of standardized, cross domain, benchmarks undermines our ability to build robust, trustworthy mod…

cs.CV2025

Challenging Vision-Language Models with Surgical Data: A New Dataset and Broad Benchmarking Study

Leon Mayer, Tim Rädsch, Dominik Michael +8

While traditional computer vision models have historically struggled to generalize to endoscopic domains, the emergence of foundation models has shown promising cross-domain perfor…

cs.CV2025★ 2 cited

False Promises in Medical Imaging AI? Assessing Validity of Outperformance Claims

Evangelia Christodoulou, Annika Reinke, Pascaline Andrè +23

Performance comparisons are fundamental in medical imaging Artificial Intelligence (AI) research, often driving claims of superiority based on relative improvements in common perfo…

cs.CV2024★ 1 cited

Beyond Knowledge Silos: Task Fingerprinting for Democratization of Medical Imaging AI

Patrick Godau, Akriti Srivastava, Constantin Ulrich +3

The field of medical imaging AI is currently undergoing rapid transformations, with methodical research increasingly translated into clinical practice. Despite these successes, res…

cs.CV2024★ 2 cited

PitVis-2023 Challenge: Workflow Recognition in videos of Endoscopic Pituitary Surgery

Adrito Das, Danyal Z. Khan, Dimitrios Psychogyios +29

The field of computer vision applied to videos of minimally invasive surgery is ever-growing. Workflow recognition pertains to the automated recognition of various aspects of a sur…

cs.CV2023★ 1 cited

Why is the winner the best?

Matthias Eisenmann, Annika Reinke, Vivienn Weru +122

International benchmarking competitions have become fundamental for the comparative performance assessment of image analysis methods. However, little attention has been given to in…

cs.CV2023★ 1 cited

Self-distillation for surgical action recognition

Amine Yamlahi, Thuy Nuong Tran, Patrick Godau +9

Surgical scene understanding is a key prerequisite for contextaware decision support in the operating room. While deep learning-based approaches have already reached or even surpas…

cs.CV2023★ 1 cited

Deployment of Image Analysis Algorithms under Prevalence Shifts

Patrick Godau, Piotr Kalinowski, Evangelia Christodoulou +5

Domain gaps are among the most relevant roadblocks in the clinical translation of machine learning (ML)-based solutions for medical image analysis. While current research focuses o…

eess.IV2023★ 42 cited

CholecTriplet2022: Show me a tool and tell me the triplet -- an endoscopic vision challenge for surgical action triplet detection

Chinedu Innocent Nwoye, Tong Yu, Saurav Sharma +46

Formalizing surgical activities as triplets of the used instruments, actions performed, and target anatomies is becoming a gold standard approach for surgical activity modeling. Th…

cs.CV2023★ 204 cited

Understanding metric-related pitfalls in image analysis validation

Annika Reinke, Minu D. Tizabi, Michael Baumgartner +75

Validation metrics are key for the reliable tracking of scientific progress and for bridging the current chasm between artificial intelligence (AI) research and its translation int…

cs.CV2022★ 17 cited

Biomedical image analysis competitions: The state of current participation practice

Matthias Eisenmann, Annika Reinke, Vivienn Weru +352

The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known abou…

cs.CV2022★ 3 cited

Sources of performance variability in deep learning-based polyp detection

Thuy Nuong Tran, Tim Adler, Amine Yamlahi +8

Validation metrics are a key prerequisite for the reliable tracking of scientific progress and for deciding on the potential clinical translation of methods. While recent initiativ…

cs.CV2022★ 469 cited

Metrics reloaded: Recommendations for image analysis validation

Lena Maier-Hein, Annika Reinke, Patrick Godau +71

Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. Particularly in automatic biomedical image analysis, chosen…

cs.CV2021★ 1 cited

Task Fingerprinting for Meta Learning in Biomedical Image Analysis

Patrick Godau, Lena Maier-Hein

Shortage of annotated data is one of the greatest bottlenecks in biomedical image analysis. Meta learning studies how learning systems can increase in efficiency through experience…

cs.CV2021★ 3 cited

How can we learn (more) from challenges? A statistical approach to driving future algorithm development

Tobias Roß, Pierangela Bruno, Annika Reinke +12

Challenges have become the state-of-the-art approach to benchmark image analysis algorithms in a comparative manner. While the validation on identical data sets was a great step fo…

eess.IV2021★ 7 cited

Machine learning-based analysis of hyperspectral images for automated sepsis diagnosis

Maximilian Dietrich, Silvia Seidlitz, Nicholas Schreck +16

Sepsis is a leading cause of mortality and critical illness worldwide. While robust biomarkers for early diagnosis are still missing, recent work indicates that hyperspectral imagi…