718 citations · 1.7k across the 14 of their papers we have counts for
15 papers
Why is the winner the best?
Matthias Eisenmann, Annika Reinke, Vivienn Weru +122
International benchmarking competitions have become fundamental for the comparative performance assessment of image analysis methods. However, little attention has been given to in…
Simulating and reporting frequentist operating characteristics of clinical trials that borrow external information
Annette Kopp-Schneider, Manuel Wiesenfarth, Leonhard Held +1
Borrowing of information from historical or external data to inform inference in a current trial is an expanding field in the era of precision medicine, where trials are often perf…
Tree-based exploratory identification of predictive biomarkers in observational data
Julia Krzykalla, Axel Benner, Annette Kopp-Schneider
The idea of "stratified medicine" is an important driver of methodological research on the identification of predictive biomarkers. Most methods proposed so far for this purpose ha…
Biomedical image analysis competitions: The state of current participation practice
Matthias Eisenmann, Annika Reinke, Vivienn Weru +352
The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known abou…
Robust incorporation of historical information with known type I error rate inflation
Silvia Calderazzo, Annette Kopp-Schneider
Bayesian clinical trials can benefit of available historical information through the elicitation of informative prior distributions. Concerns are however often raised about the pot…
Labeling instructions matter in biomedical image analysis
Tim Rädsch, Annika Reinke, Vivienn Weru +7
Biomedical image analysis algorithm validation depends on high-quality annotation of reference datasets, for which labeling instructions are key. Despite their importance, their op…
Metrics reloaded: Recommendations for image analysis validation
Lena Maier-Hein, Annika Reinke, Patrick Godau +71
Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. Particularly in automatic biomedical image analysis, chosen…
How can we learn (more) from challenges? A statistical approach to driving future algorithm development
Tobias Roß, Pierangela Bruno, Annika Reinke +12
Challenges have become the state-of-the-art approach to benchmark image analysis algorithms in a comparative manner. While the validation on identical data sets was a great step fo…
Machine learning-based analysis of hyperspectral images for automated sepsis diagnosis
Maximilian Dietrich, Silvia Seidlitz, Nicholas Schreck +16
Sepsis is a leading cause of mortality and critical illness worldwide. While robust biomarkers for early diagnosis are still missing, recent work indicates that hyperspectral imagi…
Common Limitations of Image Processing Metrics: A Picture Story
Annika Reinke, Minu D. Tizabi, Carole H. Sudre +90
While the importance of automatic image analysis is continuously increasing, recent meta-research revealed major flaws with respect to algorithm validation. Performance metrics are…
Robust Medical Instrument Segmentation Challenge 2019
Tobias Ross, Annika Reinke, Peter M. Full +47
Intraoperative tracking of laparoscopic instruments is often a prerequisite for computer and robotic-assisted interventions. While numerous methods for detecting, segmenting and tr…
Methods and open-source toolkit for analyzing and visualizing challenge results
Manuel Wiesenfarth, Annika Reinke, Bennett A. Landman +3
Biomedical challenges have become the de facto standard for benchmarking biomedical image analysis algorithms. While the number of challenges is steadily increasing, surprisingly l…
BIAS: Transparent reporting of biomedical image analysis challenges
Lena Maier-Hein, Annika Reinke, Michal Kozubek +11
The number of biomedical image analysis challenges organized per year is steadily increasing. These international competitions have the purpose of benchmarking algorithms on common…
A large annotated medical image dataset for the development and evaluation of segmentation algorithms
Amber L. Simpson, Michela Antonelli, Spyridon Bakas +21
Semantic segmentation of medical images aims to associate a pixel with a label in a medical image without human initialization. The success of semantic segmentation algorithms is c…
Why rankings of biomedical image analysis competitions should be interpreted with care
Lena Maier-Hein, Matthias Eisenmann, Annika Reinke +35
International challenges have become the standard for validation of biomedical image analysis methods. Given their scientific impact, it is surprising that a critical analysis of c…