Microarrays, Empirical Bayes and the Two-Groups Model

Abstract

The classic frequentist theory of hypothesis testing developed by Neyman, Pearson and Fisher has a claim to being the twentieth century's most influential piece of applied mathematics. Something new is happening in the twenty-first century: high-throughput devices, such as microarrays, routinely require simultaneous hypothesis tests for thousands of individual cases, not at all what the classical theory had in mind. In these situations empirical Bayes information begins to force itself upon frequentists and Bayesians alike. The two-groups model is a simple Bayesian construction that facilitates empirical Bayes analysis. This article concerns the interplay of Bayesian and frequentist ideas in the two-groups setting, with particular attention focused on Benjamini and Hochberg's False Discovery Rate method. Topics include the choice and meaning of the null hypothesis in large-scale testing situations, power considerations, the limitations of permutation methods, significance testing for groups of cases (such as pathways in microarray studies), correlation effects, multiple confidence intervals and Bayesian competitors to the two-groups model.

This paper commented in: [arXiv:0808.0582], [arXiv:0808.0593], [arXiv:0808.0597], [arXiv:0808.0599]. Rejoinder in [arXiv:0808.0603]. Published in at http://dx.doi.org/10.1214/07-STS236 the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (4)

• In silico prediction of protein-protein interactions in human macrophages
• On testing the significance of sets of genes
• Size, power and false discovery rates
• Generalizations of the Familywise Error Rate

Cited by in corpus (32)

• Bayesian inference and the parametric bootstrap
• Feature selection in omics prediction problems using cat scores and false nondiscovery rate control
• The Horseshoe Estimator: Posterior Concentration around Nearly Black Vectors
• Asymptotic Bayes-optimality under sparsity of some multiple testing procedures
• Replicability analysis for genome-wide association studies
• An empirical Bayes mixture method for effect size and false discovery rate estimation
• The Future of Indirect Evidence
• Variational Bayes for high-dimensional linear regression with sparse priors
• Asymptotically minimax empirical Bayes estimation of a sparse normal mean vector
• Are a set of microarrays independent of each other?
• FDR-Control in Multiscale Change-point Segmentation
• Optimal rates of convergence for estimating the null density and proportion of nonnull effects in large-scale multiple testing
• Multiple hypothesis testing adjusted for latent variables, with an application to the AGEMAP gene expression data
• A nonparametric empirical Bayes framework for large-scale multiple testing
• Power-enhanced multiple decision functions controlling family-wise error and false discovery rates
• Signal Identification for Rare and Weak Features: Higher Criticism or False Discovery Rates?
• Exact calculations for false discovery proportion with application to least favorable configurations
• Semiparametric inference in mixture models with predictive recursion marginal likelihood
• On false discovery rate thresholding for classification under sparsity
• Efficient inference for genetic association studies with multiple outcomes
• Laplace Approximated EM Microarray Analysis: An Empirical Bayes Approach for Comparative Microarray Experiments
• Implications of uniformly distributed, empirically informed priors for phylogeographical model selection: A reply to Hickerson et al
• An empirical Bayes testing procedure for detecting variants in analysis of next generation sequencing data
• Good, great, or lucky? Screening for firms with sustained superior performance using heavy-tailed priors
• Another Argument in Favour of Wilcoxon's Signed Rank Test
• Estimating the null distribution for conditional inference and genome-scale screening
• Bayesian latent hierarchical model for transcriptomic meta-analysis to detect biomarkers with clustered meta-patterns of differential expression signals
• Identification of significant features in DNA microarray data
• A Bayesian model averaging approach for observational gene expression studies
• Revisiting consistency of a recursive estimator of mixing distributions
• Classes of Multiple Decision Functions Strongly Controlling FWER and FDR
• Post hoc false discovery proportion inference under a Hidden Markov Model