Tempo: Helping Data Scientists and Domain Experts Collaboratively Specify Predictive Modeling Tasks

Abstract

Temporal predictive models have the potential to improve decisions in health care, public services, and other domains, yet they often fail to effectively support decision-makers. Prior literature shows that many misalignments between model behavior and decision-makers' expectations stem from issues of model specification, namely how, when, and for whom predictions are made. However, model specifications for predictive tasks are highly technical and difficult for non-data-scientist stakeholders to interpret and critique. To address this challenge we developed Tempo, an interactive system that helps data scientists and domain experts collaboratively iterate on model specifications. Using Tempo's simple yet precise temporal query language, data scientists can quickly prototype specifications with greater transparency about pre-processing choices. Moreover, domain experts can assess performance within data subgroups to validate that models behave as expected. Through three case studies, we demonstrate how Tempo helps multidisciplinary teams quickly prune infeasible specifications and identify more promising directions to explore.

Appearing at CHI 2025

References in corpus (12)

• Improving fairness in machine learning systems: What do industry practitioners need?
• Problem Formulation and Fairness
• "Brilliant AI Doctor" in Rural China: Tensions and Challenges in AI-Powered CDSS Deployment
• Trust in Data Science: Collaboration, Translation, and Accountability in Corporate Data Science Projects
• Understanding Frontline Workers' and Unhoused Individuals' Perspectives on AI Used in Homeless Services
• Zeno: An Interactive Framework for Behavioral Evaluation of Machine Learning
• EXMOS: Explanatory Model Steering Through Multifaceted Explanations and Data Configurations
• Visus: An Interactive System for Automatic Machine Learning Model Building and Curation
• Sketching AI Concepts with Capabilities and Examples: AI Innovation in the Intensive Care Unit
• Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Design
• Target specification bias, counterfactual prediction, and algorithmic fairness in healthcare
• Divisi: Interactive Search and Visualization for Scalable Exploratory Subgroup Analysis