Linear and Fisher Separability of Random Points in the d-dimensional Spherical Layer
arXiv:2002.01306 · doi:10.3390/e22111281
Abstract
Stochastic separation theorems play important role in high-dimensional data analysis and machine learning. It turns out that in high dimension any point of a random set of points can be separated from other points by a hyperplane with high probability even if the number of points is exponential in terms of dimension. This and similar facts can be used for constructing correctors for artificial intelligent systems, for determining an intrinsic dimension of data and for explaining various natural intelligence phenomena. In this paper, we refine the estimations for the number of points and for the probability in stochastic separation theorems, thereby strengthening some results obtained earlier. We propose the boundaries for linear and Fisher separability, when the points are drawn randomly, independently and uniformly from a -dimensional spherical layer. These results allow us to better outline the applicability limits of the stochastic separation theorems in applications.
arXiv comment6 pages, 3 figures IJCNN 2020 Accepted
References in corpus (7)
- Observed Universality of Phase Transitions in High-Dimensional Geometry, with Implications for Modern Data Analysis and Signal Processing
- Correction of AI systems by linear discriminants: Probabilistic foundations
- The unreasonable effectiveness of small neural ensembles in high-dimensional brain
- Stochastic Separation Theorems
- High--Dimensional Brain in a High-Dimensional World: Blessing of Dimensionality
- One-Trial Correction of Legacy AI Systems and Stochastic Separation Theorems
- General stochastic separation theorems with optimal bounds