Risk-based decision making: estimands for sequential prediction under interventions

Abstract

Prediction models are used amongst others to inform medical decisions on interventions. Typically, individuals with high risks of adverse outcomes are advised to undergo an intervention while those at low risk are advised to refrain from it. Standard prediction models do not always provide risks that are relevant to inform such decisions: e.g., an individual may be estimated to be at low risk because similar individuals in the past received an intervention which lowered their risk. Therefore, prediction models supporting decisions should target risks belonging to defined intervention strategies. Previous works on prediction under interventions assumed that the prediction model was used only at one time point to make an intervention decision. In clinical practice, intervention decisions are rarely made only once: they might be repeated, deferred and re-evaluated. This requires estimated risks under interventions that can be reconsidered at several potential decision moments. In the current work, we highlight key considerations for formulating estimands in sequential prediction under interventions that can inform such intervention decisions. We illustrate these considerations by giving examples of estimands for a case study about choosing between vaginal delivery and cesarean section for women giving birth. Our formalization of prediction tasks in a sequential, causal, and estimand context provides guidance for future studies to ensure that the right question is answered and appropriate causal estimation approaches are chosen to develop sequential prediction models that can inform intervention decisions.

arXiv comment32 pages, 2 figures

References in corpus (10)

• Data science is science's second chance to get causal inference right: A classification of data science tasks
• Structural Nested Models and G-estimation: The Partially Realized Promise
• Machine Learning Estimation of Heterogeneous Causal Effects: Empirical Monte Carlo Evidence
• Identifying the consequences of dynamic treatment strategies: A decision-theoretic overview
• A tutorial on individualized treatment effect prediction from randomized trials with a binary endpoint
• Prediction under interventions: evaluation of counterfactual performance using longitudinal observational data
• Counterfactual Predictions under Runtime Confounding
• Estimating and evaluating counterfactual prediction models
• On Weighted Orthogonal Learners for Heterogeneous Treatment Effects
• How to relate potential outcomes: Estimating individual treatment effects under a given specified partial correlation