Covariate Balance in Simple, Stratified and Clustered Comparative Studies
arXiv:0808.3857 · doi:10.1214/08-STS254
Abstract
In randomized experiments, treatment and control groups should be roughly the same--balanced--in their distributions of pretreatment variables. But how nearly so? Can descriptive comparisons meaningfully be paired with significance tests? If so, should there be several such tests, one for each pretreatment variable, or should there be a single, omnibus test? Could such a test be engineered to give easily computed -values that are reliable in samples of moderate size, or would simulation be needed for reliable calibration? What new concerns are introduced by random assignment of clusters? Which tests of balance would be optimal? To address these questions, Fisher's randomization inference is applied to the question of balance. Its application suggests the reversal of published conclusions about two studies, one clinical and the other a field experiment in political participation.
Published in at http://dx.doi.org/10.1214/08-STS254 the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org)
Cited by in corpus (11)
- Propensity score matching in SPSS
- A new graph-based two-sample test for multivariate and object data
- The sensitivity of linear regression coefficients' confidence limits to the omission of a confounder
- Randomization Tests that Condition on Non-Categorical Covariate Balance
- Student Log-Data from a Randomized Evaluation of Educational Technology: A Causal Case Study
- Prioritizing Variables for Observational Study Design using the Joint Variable Importance Plot
- The Local Randomization Framework for Regression Discontinuity Designs: A Review and Some Extensions
- New multivariate tests for assessing covariate balance in matched observational studies
- Kernel Discrepancy-Based Rerandomization for Controlled Experiments
- A new non-parametric test for multivariate paired data from pair matching or paired designs
- Efficient Balanced Treatment Assignments for Experimentation