99 citations · 347 across the 39 of their papers we have counts for
18 papers · 1 filter
Input-gradient space particle inference for neural network ensembles
Trung Trinh, Markus Heinonen, Luigi Acerbi +1
Deep Ensembles (DEs) demonstrate improved accuracy, calibration and robustness to perturbations over single neural networks partly due to their functional diversity. Particle-based…
Learning Energy Conserving Dynamics Efficiently with Hamiltonian Gaussian Processes
Magnus Ross, Markus Heinonen
Hamiltonian mechanics is one of the cornerstones of natural sciences. Recently there has been significant interest in learning Hamiltonian systems in a free-form way directly from…
Tackling covariate shift with node-based Bayesian neural networks
Trung Trinh, Markus Heinonen, Luigi Acerbi +1
Bayesian neural networks (BNNs) promise improved generalization under covariate shift by providing principled probabilistic representations of epistemic uncertainty. However, weigh…
De-randomizing MCMC dynamics with the diffusion Stein operator
Zheyang Shen, Markus Heinonen, Samuel Kaski
Approximate Bayesian inference estimates descriptors of an intractable target distribution - in essence, an optimization problem within a family of distributions. For example, Lang…
Sample-efficient reinforcement learning using deep Gaussian processes
Charles Gadd, Markus Heinonen, Harri Lähdesmäki +1
Reinforcement learning provides a framework for learning to control which actions to take towards completing a task through trial-and-error. In many applications observing interact…
Scalable Bayesian neural networks by layer-wise input augmentation
Trung Trinh, Samuel Kaski, Markus Heinonen
We introduce implicit Bayesian neural networks, a simple and scalable approach for uncertainty representation in deep learning. Standard Bayesian approach to deep learning requires…
Sparse Gaussian Processes Revisited: Bayesian Approaches to Inducing-Variable Approximations
Simone Rossi, Markus Heinonen, Edwin V. Bonilla +2
Variational inference techniques based on inducing variables provide an elegant framework for scalable posterior estimation in Gaussian process (GP) models. Besides enabling scalab…
ODEVAE: Deep generative second order ODEs with Bayesian neural networks
Çağatay Yıldız, Markus Heinonen, Harri Lähdesmäki
We present Ordinary Differential Equation Variational Auto-Encoder (ODEVAE), a latent second order ODE model for high-dimensional sequential data. Leveraging the advances in de…
Learning spectrograms with convolutional spectral kernels
Zheyang Shen, Markus Heinonen, Samuel Kaski
We introduce the convolutional spectral kernel (CSK), a novel family of non-stationary, nonparametric covariance kernels for Gaussian process (GP) models, derived from the convolut…
Harmonizable mixture kernels with variational Fourier features
Zheyang Shen, Markus Heinonen, Samuel Kaski
The expressive power of Gaussian processes depends heavily on the choice of kernel. In this work we propose the novel harmonizable mixture kernel (HMK), a family of expressive, int…
Learning Stochastic Differential Equations With Gaussian Processes Without Gradient Matching
Cagatay Yildiz, Markus Heinonen, Jukka Intosalmi +2
We introduce a novel paradigm for learning non-parametric drift and diffusion functions for stochastic differential equation (SDE). The proposed model learns to simulate path distr…
Bayesian Metabolic Flux Analysis reveals intracellular flux couplings
Markus Heinonen, Maria Osmala, Henrik Mannerström +4
Metabolic flux balance analyses are a standard tool in analysing metabolic reaction rates compatible with measurements, steady-state and the metabolic reaction network stoichiometr…
mGPfusion: Predicting protein stability changes with Gaussian process kernel learning and data fusion
Emmi Jokinen, Markus Heinonen, Harri Lähdesmäki
Proteins are commonly used by biochemical industry for numerous processes. Refining these proteins' properties via mutations causes stability effects as well. Accurate computationa…
Variational zero-inflated Gaussian processes with sparse kernels
Pashupati Hegde, Markus Heinonen, Samuel Kaski
Zero-inflated datasets, which have an excess of zero outputs, are commonly encountered in problems such as climate or rare event modelling. Conventional machine learning approaches…
Learning unknown ODE models with Gaussian processes
Markus Heinonen, Cagatay Yildiz, Henrik Mannerström +2
In conventional ODE modelling coefficients of an equation driving the system state forward in time are estimated. However, for many complex systems it is practically impossible to…
Non-Stationary Spectral Kernels
Sami Remes, Markus Heinonen, Samuel Kaski
We propose non-stationary spectral kernels for Gaussian process regression. We propose to model the spectral density of a non-stationary kernel function as a mixture of input-depen…
A Mutually-Dependent Hadamard Kernel for Modelling Latent Variable Couplings
Sami Remes, Markus Heinonen, Samuel Kaski
We introduce a novel kernel that models input-dependent couplings across multiple latent processes. The pairwise joint kernel measures covariance along inputs and across different…
Non-Stationary Gaussian Process Regression with Hamiltonian Monte Carlo
Markus Heinonen, Henrik Mannerström, Juho Rousu +2
We present a novel approach for fully non-stationary Gaussian process regression (GPR), where all three key parameters -- noise variance, signal variance and lengthscale -- can be…