Comments on Leo Breiman's paper 'Statistical Modeling: The Two Cultures' (Statistical Science, 2001, 16(3), 199-231)
arXiv:2103.11327
Abstract
Breiman challenged statisticians to think more broadly, to step into the unknown, model-free learning world, with him paving the way forward. Statistics community responded with slight optimism, some skepticism, and plenty of disbelief. Today, we are at the same crossroad anew. Faced with the enormous practical success of model-free, deep, and machine learning, we are naturally inclined to think that everything is resolved. A new frontier has emerged; the one where the role, impact, or stability of the {\it learning} algorithms is no longer measured by prediction quality, but an inferential one -- asking the questions of {\it why} and {\it if} can no longer be safely ignored.
arXiv comment12 pages, 2 figures
References in corpus (13)
- Simultaneous analysis of Lasso and Dantzig selector
- Reconciling modern machine learning practice and the bias-variance trade-off
- Neural Tangent Kernel: Convergence and Generalization in Neural Networks
- Consistency of random forests
- Veridical Data Science
- Adaptive Concentration of Regression Trees, with Application to Random Forests
- The Power of Interpolation: Understanding the Effectiveness of SGD in Modern Over-parametrized Learning
- Geometry of Optimization and Implicit Regularization in Deep Learning
- Tailor-made tests for goodness of fit to semiparametric hypotheses
- Implicit Regularization in Deep Learning May Not Be Explainable by Norms
- Testability of high-dimensional linear models with non-sparse structures
- On the infinite width limit of neural networks with a standard parameterization
- Semi-Supervised linear regression