Auditing Significance, Metric Choice, and Demographic Fairness in Medical AI Challenges

Ariel Lubonja, Pedro R. A. S. Bassi, Wenxuan Li +4

Open challenges have become the de facto standard for comparative ranking of medical AI methods. Despite their importance, medical AI leaderboards exhibit three persistent limitati…