Blessing of dimensionality at the edge

Abstract

In this paper we present theory and algorithms enabling classes of Artificial Intelligence (AI) systems to continuously and incrementally improve with a-priori quantifiable guarantees - or more specifically remove classification errors - over time. This is distinct from state-of-the-art machine learning, AI, and software approaches. Another feature of this approach is that, in the supervised setting, the computational complexity of training is linear in the number of training samples. At the time of classification, the computational complexity is bounded by few inner product calculations. Moreover, the implementation is shown to be very scalable. This makes it viable for deployment in applications where computational power and memory are limited, such as embedded environments. It enables the possibility for fast on-line optimisation using improved training samples. The approach is based on the concentration of measure effects and stochastic separation theorems and is illustrated with an example on the identification faulty processes in Computer Numerical Control (CNC) milling and with a case study on adaptive removal of false positives in an industrial video surveillance and analytics system.

References in corpus (18)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Overcoming catastrophic forgetting in neural networks
• Prototypical Networks for Few-shot Learning
• Matching Networks for One Shot Learning
• Stochastic Configuration Networks: Fundamentals and Algorithms
• Intrinsic dimension of data representations in deep neural networks
• Approximation with Random Bases: Pro et Contra
• Blessing of dimensionality: mathematical foundations of the statistical physics of data
• Improving the Robustness of Deep Neural Networks via Stability Training
• Correction of AI systems by linear discriminants: Probabilistic foundations
• The unreasonable effectiveness of small neural ensembles in high-dimensional brain
• Stochastic Separation Theorems
• High--Dimensional Brain in a High-Dimensional World: Blessing of Dimensionality
• Knowledge Transfer Between Artificial Intelligence Systems
• One-Trial Correction of Legacy AI Systems and Stochastic Separation Theorems
• General stochastic separation theorems with optimal bounds
• Fast Construction of Correcting Ensembles for Legacy Artificial Intelligence Systems: Algorithms and a Case Study
• Augmented Artificial Intelligence: a Conceptual Framework

Cited by in corpus (2)

• High-dimensional separability for one- and few-shot learning
• Learning from scarce information: using synthetic data to classify Roman fine ware pottery