activity
20242026
most citedFalse Promises in Medical Imaging AI? Assessing Validity of Outperformance Claims

2 citations · 3 across the 7 of their papers we have counts for

collaborators

8 papers

cs.CV2026

HeiCo-FOCUS: A Clinically Grounded Dataset for Long-Context Video Understanding

Leon Mayer, Lucas Luttner, Patrick Godau +42

Recent advances in Vision-Language Models (VLMs) have led to rapid progress in video understanding across a wide range of benchmark tasks. However, existing evaluations largely foc…

cs.CV2025

6 Fingers, 1 Kidney: Natural Adversarial Medical Images Reveal Critical Weaknesses of Vision-Language Models

Leon Mayer, Piotr Kalinowski, Caroline Ebersbach +6

Vision-language models (VLMs) are increasingly integrated into clinical workflows. However, existing benchmarks primarily assess performance on common anatomical presentations and…

q-bio.OT2025★ 1 cited

Current validation practice undermines surgical AI development

Annika Reinke, Ziying O. Li, Minu D. Tizabi +98

Surgical data science (SDS) is rapidly advancing, yet clinical adoption of artificial intelligence (AI) in surgery remains limited, with inadequate validation as an important contr…

cs.CV2025

Challenging Vision-Language Models with Surgical Data: A New Dataset and Broad Benchmarking Study

Leon Mayer, Tim Rädsch, Dominik Michael +8

While traditional computer vision models have historically struggled to generalize to endoscopic domains, the emergence of foundation models has shown promising cross-domain perfor…

cs.CV2025

Large-scale Self-supervised Video Foundation Model for Intelligent Surgery

Shu Yang, Fengtao Zhou, Leon Mayer +16

Computer-Assisted Intervention (CAI) has the potential to revolutionize modern surgery, with surgical scene understanding serving as a critical component in supporting decision-mak…

cs.CV2025★ 2 cited

False Promises in Medical Imaging AI? Assessing Validity of Outperformance Claims

Evangelia Christodoulou, Annika Reinke, Pascaline Andrè +23

Performance comparisons are fundamental in medical imaging Artificial Intelligence (AI) research, often driving claims of superiority based on relative improvements in common perfo…

cs.CV2025

Bridging vision language model (VLM) evaluation gaps with a framework for scalable and cost-effective benchmark generation

Tim Rädsch, Leon Mayer, Simon Pavicic +8

Reliable evaluation of AI models is critical for scientific progress and practical application. While existing VLM benchmarks provide general insights into model capabilities, thei…

cs.CV2024

Confidence intervals uncovered: Are we ready for real-world medical imaging AI?

Evangelia Christodoulou, Annika Reinke, Rola Houhou +19

Medical imaging is spearheading the AI transformation of healthcare. Performance reporting is key to determine which methods should be translated into clinical practice. Frequently…