REAL ML: Recognizing, Exploring, and Articulating Limitations of Machine Learning Research

Abstract

Transparency around limitations can improve the scientific rigor of research, help ensure appropriate interpretation of research findings, and make research claims more credible. Despite these benefits, the machine learning (ML) research community lacks well-developed norms around disclosing and discussing limitations. To address this gap, we conduct an iterative design process with 30 ML and ML-adjacent researchers to develop and test REAL ML, a set of guided activities to help ML researchers recognize, explore, and articulate the limitations of their research. Using a three-stage interview and survey study, we identify ML researchers' perceptions of limitations, as well as the challenges they face when recognizing, exploring, and articulating limitations. We develop REAL ML to address some of these practical challenges, and highlight additional cultural challenges that will require broader shifts in community norms to address. We hope our study and REAL ML help move the ML research community toward more active and appropriate engagement with limitations.

arXiv commentThis work appears in the 2022 ACM Conference on Fairness, Accountability, and Transparency (FAccT '22)

References in corpus (5)

• Model Cards for Model Reporting
• Machine Learning that Matters
• Value Cards: An Educational Toolkit for Teaching Social Impacts of Machine Learning through Deliberation
• Unpacking the Expressed Consequences of AI Research in Broader Impact Statements
• Thinking Through and Writing About Research Ethics Beyond "Broader Impact"

Cited by in corpus (5)

• Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations
• Farsight: Fostering Responsible AI Awareness During AI Application Prototyping
• Supporting Industry Computing Researchers in Assessing, Articulating, and Addressing the Potential Negative Societal Impact of Their Work
• From Model Performance to Claim: How a Change of Focus in Machine Learning Replicability Can Help Bridge the Responsibility Gap
• Talking About the Assumption in the Room