Kernel methods in machine learning

Abstract

We review machine learning methods employing positive definite kernels. These methods formulate learning and estimation problems in a reproducing kernel Hilbert space (RKHS) of functions defined on the data domain, expanded in terms of a kernel. Working in linear spaces of function has the benefit of facilitating the construction and analysis of learning algorithms while at the same time allowing large classes of functions. The latter include nonlinear functions as well as functions defined on nonvectorial data. We cover a wide range of methods, ranging from binary classifiers to sophisticated methods for estimation with structured data.

Published in at http://dx.doi.org/10.1214/009053607000000677 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (1)

• Learning to Map Sentences to Logical Form: Structured Classification with Probabilistic Categorial Grammars

Cited by in corpus (141)

• Machine learning and the physical sciences
• Recent Advances in Physical Reservoir Computing: A Review
• Quantum support vector machine for big data classification
• Noisy intermediate-scale quantum (NISQ) algorithms
• Quantum machine learning in feature Hilbert spaces
• Machine Learning Force Fields
• Explainable Machine Learning for Scientific Insights and Discoveries
• Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks
• Machine learning for electronically excited states of molecules
• The Expressive Power of Parameterized Quantum Circuits
• Differentiable Learning of Quantum Circuit Born Machine
• Accelerated materials property predictions and design using motif-based fingerprints
• Predicting popularity of online videos using Support Vector Regression
• A Survey of Contextual Optimization Methods for Decision Making under Uncertainty
• Representations of molecules and materials for interpolation of quantum-mechanical simulations via machine learning
• Learning physical descriptors for materials science by compressed sensing
• Parallel Transport on the Cone Manifold of SPD Matrices for Domain Adaptation
• Eigendecompositions of Transfer Operators in Reproducing Kernel Hilbert Spaces
• Pattern recognition with neuromorphic computing using magnetic-field induced dynamics of skyrmions
• Guest Editorial: Special Topic on Data-enabled Theoretical Chemistry
• Learning Relevant Features of Data with Multi-scale Tensor Networks
• Bayesian machine learning for quantum molecular dynamics
• Towards understanding the power of quantum kernels in the NISQ era
• A Correlative Denoising Autoencoder to Model Social Influence for Top-N Recommender System
• Operator-theoretic framework for forecasting nonlinear time series with kernel analog techniques
• MLatom 3: Platform for machine learning-enhanced computational chemistry simulations and workflows
• Kernel PCA for type Ia supernovae photometric classification
• Learning molecular energies using localized graph kernels
• Training Data Influence Analysis and Estimation: A Survey
• The complexity of quantum support vector machines
• The theory of the quantum kernel-based binary classifier
• High-Dimensional Potential Energy Surfaces for Molecular Simulations
• Permutationally Invariant, Reproducing Kernel-Based Potential Energy Surfaces for Polyatomic Molecules: From Formaldehyde to Acetone
• Statistical Mechanics of Deep Linear Neural Networks: The Back-Propagating Kernel Renormalization
• Transductive Ordinal Regression
• Machine learning classification of CHIME fast radio bursts -- I. Supervised methods
• RAT: Reinforcement-Learning-Driven and Adaptive Testing for Vulnerability Discovery in Web Application Firewalls
• A bag-of-paths framework for network data analysis
• Tensors in computations
• GLYFE: Review and Benchmark of Personalized Glucose Predictive Models in Type-1 Diabetes
• GSVMA: A Genetic-Support Vector Machine-Anova method for CAD diagnosis based on Z-Alizadeh Sani dataset
• Distributed Adaptive Learning with Multiple Kernels in Diffusion Networks
• Fock State-enhanced Expressivity of Quantum Machine Learning Models
• Measures of Causality in Complex Datasets with application to financial data
• Unifying Graph Convolution and Contrastive Learning in Collaborative Filtering
• Noisy Quantum Kernel Machines
• A literature survey of matrix methods for data science
• Distinction of groups of gamma-ray bursts in the BATSE catalog through fuzzy clustering
• Binary and Multiclass Classifiers based on Multitaper Spectral Features for Epilepsy Detection
• Variational Information Bottleneck for Unsupervised Clustering: Deep Gaussian Mixture Embedding
• Dynamics on Multiple Potential Energy Surfaces: Quantitative Studies of Elementary Processes Relevant to Hypersonics
• Dequantizing quantum machine learning models using tensor networks
• Direct Symbol Decoding using GA-SVM in Chaotic Baseband Wireless Communication System
• Two phase formation of massive elliptical galaxies : study through cross-correlation including spatial effect
• Gaussian RBF Centered Kernel Alignment (CKA) in the Large Bandwidth Limit
• Adiabatic Quantum Kitchen Sinks for Learning Kernels Using Randomized Features
• 1-Dimensional polynomial neural networks for audio signal related problems
• Manifold Matching using Shortest-Path Distance and Joint Neighborhood Selection
• Machine Learning for compositional disorder: A Comparison Between Different Descriptors and Machine Learning Frameworks
• Laplacian Eigenmaps from Sparse, Noisy Similarity Measurements
• Sparsification of the Alignment Path Search Space in Dynamic Time Warping
• Rdimtools: An R package for Dimension Reduction and Intrinsic Dimension Estimation
• Random Forest Kernel for High-Dimension Low Sample Size Classification
• Quantum mean centering for block-encoding-based quantum algorithm
• Artificial Intelligence and Dimensionality Reduction: Tools for approaching future communications
• OnRAMP for Regulating AI in Medical Products
• On the numerical rank of radial basis function kernels in high dimension
• Perception Evaluation -- A new solar image quality metric based on the multi-fractal property of texture features
• Efficient Parameter Optimisation for Quantum Kernel Alignment: A Sub-sampling Approach in Variational Training
• Learning Representations from Dendrograms
• SketchNE: Embedding Billion-Scale Networks Accurately in One Hour
• Expressivity of Variational Quantum Machine Learning on the Boolean Cube
• Discriminative Transformation Learning for Fuzzy Sparse Subspace Clustering
• Learning ground states of gapped quantum Hamiltonians with Kernel Methods
• DCT and DST Filtering with Sparse Graph Operators
• Distribution-Free Uncertainty Quantification for Kernel Methods by Gradient Perturbations
• Explainable Representation Learning of Small Quantum States
• A Continuous Variable Born Machine
• Discriminative Nonlinear Analysis Operator Learning: When Cosparse Model Meets Image Classification
• A Comparative Study of Machine Learning Methods for X-ray Binary Classification
• Faster variational quantum algorithms with quantum kernel-based surrogate models
• Analog quantum variational embedding classifier
• The Power of One Clean Qubit in Supervised Machine Learning
• Kernel Recursive Least Squares Dictionary Learning Algorithm
• Phase-space negativity as a computational resource for quantum kernel methods
• TPLVM: Portfolio Construction by Student's $t$-process Latent Variable Model
• Fundamental weight systems are quantum states
• General Signature Kernels
• Multiple Kernel Representation Learning on Networks
• Quantum Supervised Learning
• Reconstructing partonic kinematics at colliders with Machine Learning
• The Geometry of Nonlinear Embeddings in Kernel Discriminant Analysis
• Unsupervised Assignment Flow: Label Learning on Feature Manifolds by Spatially Regularized Geometric Assignment
• Risk Convergence of Centered Kernel Ridge Regression with Large Dimensional Data
• Early years of Biased Random-Key Genetic Algorithms: A systematic review
• Quantum Kernel Machine Learning With Continuous Variables
• Roweis Discriminant Analysis: A Generalized Subspace Learning Method
• The Geometry of Adversarial Training in Binary Classification
• SAR Tomography via Nonlinear Blind Scatterer Separation
• Training Support Vector Machines Using Frank-Wolfe Optimization Methods
• Classification of local ultraluminous infrared galaxies and quasars with kernel principal component analysis
• Learning in High-Dimensional Feature Spaces Using ANOVA-Based Fast Matrix-Vector Multiplication
• Stein Variational Gradient Descent with Multiple Kernel
• Quantum Kernel Evaluation via Hong-Ou-Mandel Interference
• Randomized Kernel Methods for Least-Squares Support Vector Machines
• Non-Classical Kernels in Continuous Variable Systems
• Continuous-variable nonlocality and contextuality
• Gabor frames and deep scattering networks in audio processing
• Theoretical Insights into the Use of Structural Similarity Index In Generative Models and Inferential Autoencoders
• Data-Driven Batch Localization and SLAM Using Koopman Linearization
• Kernel-based parameter estimation of dynamical systems with unknown observation functions
• Koopman operators with intrinsic observables in rigged reproducing kernel Hilbert spaces
• Non-parametric Semi-Supervised Learning in Many-body Hilbert Space with Rescaled Logarithmic Fidelity
• $L^p$ Error Estimates for Approximation by Sobolev Splines and Wendland Functions on ${\mathbb{R}}^d$
• Collective variables between large-scale states in turbulent convection
• Functional Principal Component Analysis for Extrapolating Multi-stream Longitudinal Data
• Towards a Kernel based Uncertainty Decomposition Framework for Data and Models
• Kernel-based diffusion approximated Markov decision processes for autonomous navigation and control on unstructured terrains
• Accurate Unsupervised Photon Counting from Transition Edge Sensor Signals
• Machine learning for accelerated bandgap prediction in strain-engineered quaternary III-V semiconductors
• On a link between kernel mean maps and Fraunhofer diffraction, with an application to super-resolution beyond the diffraction limit
• Staying the course: Locating equilibria of dynamical systems on Riemannian manifolds defined by point-clouds
• Network Distance Based on Laplacian Flows on Graphs
• Quadratic speed-ups in quantum kernelized binary classification
• Machine Learning in Viscoelastic Fluids via Energy-Based Kernel Embedding
• Spectraformer: A Unified Random Feature Framework for Transformer
• Super-exponential decay rates for eigenvalues and singular values of integral operators on the sphere
• Schur expansion of random-matrix reproducing kernels
• Unsupervised Representation Learning with Minimax Distance Measures
• Anomaly Detection and Prototype Selection Using Polyhedron Curvature
• Testing for a Random Walk Structure in the Frequency Evolution of a Tone in Noise
• Polynomial degree reduction in the ${\mathcal{L}}^2$-norm on a symmetric interval for the canonical basis
• Emulating complex dynamical simulators with random Fourier features
• Empirical Power of Quantum Encoding Methods for Binary Classification
• Hyperbolic embedding of brain networks as a tool for epileptic seizures forecasting
• Machine learning-powered data cleaning for LEGEND: a semi-supervised approach using affinity propagation and support vector machines
• Modeling and benchmarking quantum optical neurons for efficient neural computation
• The Interplay between Quantum Contextuality and Wigner Negativity
• Nonparametric, Nonasymptotic Confidence Bands with Paley-Wiener Kernels for Band-Limited Functions
• Principal Component Analysis Using Structural Similarity Index for Images
• Training Hybrid Classical-Quantum Classifiers via Stochastic Variational Optimization