Theoretical Limitations of Ensembles in the Age of Overparameterization

Niclas Dern, John P. Cunningham, Geoff Pleiss

Classic ensembles generalize better than any single component model. In contrast, recent empirical studies find that modern ensembles of (overparameterized) neural networks may not…