Symphony of high-dimensional brain
arXiv:1906.12222 · doi:10.1016/j.plrev.2019.06.003
Abstract
This paper is the final part of the scientific discussion organised by the Journal "Physics of Life Rviews" about the simplicity revolution in neuroscience and AI. This discussion was initiated by the review paper "The unreasonable effectiveness of small neural ensembles in high-dimensional brain". Phys Life Rev 2019, doi 10.1016/j.plrev.2018.09.005, arXiv:1809.07656. The topics of the discussion varied from the necessity to take into account the difference between the theoretical random distributions and "extremely non-random" real distributions and revise the common machine learning theory, to different forms of the curse of dimensionality and high-dimensional pitfalls in neuroscience. V. K{ů}rkov{á}, A. Tozzi and J.F. Peters, R. Quian Quiroga, P. Varona, R. Barrio, G. Kreiman, L. Fortuna, C. van Leeuwen, R. Quian Quiroga, and V. Kreinovich, A.N. Gorban, V.A. Makarov, and I.Y. Tyukin participated in the discussion. In this paper we analyse the symphony of opinions and the possible outcomes of the simplicity revolution for machine learning and neuroscience.
References in corpus (10)
- Observed Universality of Phase Transitions in High-Dimensional Geometry, with Implications for Modern Data Analysis and Signal Processing
- Principal manifolds and graphs in practice: from molecular biology to dynamical systems
- Approximation with Random Bases: Pro et Contra
- Blessing of dimensionality: mathematical foundations of the statistical physics of data
- Correction of AI systems by linear discriminants: Probabilistic foundations
- The unreasonable effectiveness of small neural ensembles in high-dimensional brain
- Stochastic Separation Theorems
- High-dimensional brain. A tool for encoding and rapid learning of memories by single neurons
- Data complexity measured by principal graphs
- Augmented Artificial Intelligence: a Conceptual Framework