Automated Spectral Kernel Learning
arXiv:1909.04894 · doi:10.1609/aaai.v34i04.5892
Abstract
The generalization performance of kernel methods is largely determined by the kernel, but common kernels are stationary thus input-independent and output-independent, that limits their applications on complicated tasks. In this paper, we propose a powerful and efficient spectral kernel learning framework and learned kernels are dependent on both inputs and outputs, by using non-stationary spectral kernels and flexibly learning the spectral measure from the data. Further, we derive a data-dependent generalization error bound based on Rademacher complexity, which estimates the generalization ability of the learning framework and suggests two regularization terms to improve performance. Extensive experimental results validate the effectiveness of the proposed algorithm and confirm our theoretical results.
arXiv commentPublised in AAAI 2020
References in corpus (8)
- Adam: A Method for Stochastic Optimization
- ADADELTA: An Adaptive Learning Rate Method
- Matrix estimation by Universal Singular Value Thresholding
- Gaussian Process Kernels for Pattern Discovery and Extrapolation
- Functional Variational Bayesian Neural Networks
- Generalized Singular Value Thresholding
- Non-Stationary Spectral Kernels
- Generalized Spectral Kernels