One-Trial Correction of Legacy AI Systems and Stochastic Separation Theorems
arXiv:1610.00494 · doi:10.1016/j.ins.2019.02.001
Abstract
We consider the problem of efficient "on the fly" tuning of existing, or {\it legacy}, Artificial Intelligence (AI) systems. The legacy AI systems are allowed to be of arbitrary class, albeit the data they are using for computing interim or final decision responses should posses an underlying structure of a high-dimensional topological real vector space. The tuning method that we propose enables dealing with errors without the need to re-train the system. Instead of re-training a simple cascade of perceptron nodes is added to the legacy system. The added cascade modulates the AI legacy system's decisions. If applied repeatedly, the process results in a network of modulating rules "dressing up" and improving performance of existing AI systems. Mathematical rationale behind the method is based on the fundamental property of measure concentration in high dimensional spaces. The method is illustrated with an example of fine-tuning a deep convolutional network that has been pre-trained to detect pedestrians in images.
References in corpus (6)
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- Intriguing properties of neural networks
- MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
- Approximation with Random Bases: Pro et Contra
- Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Images
- The More, the Merrier: the Blessing of Dimensionality for Learning Large Gaussian Mixtures
Cited by in corpus (10)
- Correction of AI systems by linear discriminants: Probabilistic foundations
- The unreasonable effectiveness of small neural ensembles in high-dimensional brain
- Stochastic Separation Theorems
- High--Dimensional Brain in a High-Dimensional World: Blessing of Dimensionality
- Knowledge Transfer Between Artificial Intelligence Systems
- Fast Construction of Correcting Ensembles for Legacy Artificial Intelligence Systems: Algorithms and a Case Study
- Augmented Artificial Intelligence: a Conceptual Framework
- Blessing of dimensionality at the edge
- MyI-Net: Fully Automatic Detection and Quantification of Myocardial Infarction from Cardiovascular MRI Images
- Linear and Fisher Separability of Random Points in the d-dimensional Spherical Layer