Harmonizable mixture kernels with variational Fourier features
arXiv:1810.04416
Abstract
The expressive power of Gaussian processes depends heavily on the choice of kernel. In this work we propose the novel harmonizable mixture kernel (HMK), a family of expressive, interpretable, non-stationary kernels derived from mixture models on the generalized spectral representation. As a theoretically sound treatment of non-stationary kernels, HMK supports harmonizable covariances, a wide subset of kernels including all stationary and many non-stationary covariances. We also propose variational Fourier features, an inter-domain sparse GP inference framework that offers a representative set of 'inducing frequencies'. We show that harmonizable mixture kernels interpolate between local patterns, and that variational Fourier features offers a robust kernel learning framework for the new kernel family.
18 pages, 5 figures
Cited by in corpus (4)
- Random Features for Kernel Approximation: A Survey on Algorithms, Theory, and Beyond
- On Learning the Transformer Kernel
- Recent Advances in Data-Driven Wireless Communication Using Gaussian Processes: A Comprehensive Survey
- Gaussian Processes with Skewed Laplace Spectral Mixture Kernels for Long-term Forecasting