280 citations · 2k across the 81 of their papers we have counts for
52 papers · 1 filter
Geometric Neural Diffusion Processes
Emile Mathieu, Vincent Dutordoir, Michael J. Hutchinson +3
Denoising diffusion models have proven to be a flexible and effective paradigm for generative modelling. Their recent extension to infinite dimensional Euclidean spaces has allowed…
Autoregressive Conditional Neural Processes
Wessel P. Bruinsma, Stratis Markou, James Requiema +6
Conditional neural processes (CNPs; Garnelo et al., 2018a) are attractive meta-learning models which produce well-calibrated predictions and are trainable via a simple maximum like…
On the Efficacy of Differentially Private Few-shot Image Classification
Marlon Tobaben, Aliaksandra Shysheya, John Bronskill +5
There has been significant recent progress in training differentially private (DP) models which achieve accuracy that approaches the best non-private models. These DP models are ty…
Environmental Sensor Placement with Convolutional Gaussian Neural Processes
Tom R. Andersson, Wessel P. Bruinsma, Stratis Markou +8
Environmental sensors are crucial for monitoring weather conditions and the impacts of climate change. However, it is challenging to place sensors in a way that maximises the infor…
Ice Core Dating using Probabilistic Programming
Aditya Ravuri, Tom R. Andersson, Ieva Kazlauskaite +5
Ice cores record crucial information about past climate. However, before ice core data can have scientific value, the chronology must be inferred by estimating the age as a functio…
FiT: Parameter Efficient Few-shot Transfer Learning for Personalized and Federated Image Classification
Aliaksandra Shysheya, John Bronskill, Massimiliano Patacchiola +2
Modern deep learning systems are increasingly deployed in situations such as personalization and federated learning where it is necessary to support i) learning on small amounts of…
Modelling Non-Smooth Signals with Complex Spectral Structure
Wessel P. Bruinsma, Martin Tegnér, Richard E. Turner
The Gaussian Process Convolution Model (GPCM; Tobar et al., 2015a) is a model for signals with complex spectral structure. A significant limitation of the GPCM is that it assumes a…
Practical Conditional Neural Processes Via Tractable Dependent Predictions
Stratis Markou, James Requeima, Wessel P. Bruinsma +2
Conditional Neural Processes (CNPs; Garnelo et al., 2018a) are meta-learning models which leverage the flexibility of deep learning to produce well-calibrated predictions and natur…
Partitioned Variational Inference: A Framework for Probabilistic Federated Learning
Matthew Ashman, Thang D. Bui, Cuong V. Nguyen +4
The proliferation of computing devices has brought about an opportunity to deploy machine learning models on new problem domains using previously inaccessible data. Traditional alg…
Memory Efficient Meta-Learning with Large Images
John Bronskill, Daniela Massiceti, Massimiliano Patacchiola +3
Meta learning approaches to few-shot classification are computationally efficient at test time, requiring just a few optimization steps or single forward pass to learn a new task,…
How Tight Can PAC-Bayes be in the Small Data Regime?
Andrew Y. K. Foong, Wessel P. Bruinsma, David R. Burt +1
In this paper, we investigate the question: Given a small number of datapoints, for example N = 30, how tight can PAC-Bayes and test set bounds be made? For such small datasets, te…
Bayesian Neural Network Priors Revisited
Vincent Fortuin, Adrià Garriga-Alonso, Sebastian W. Ober +5
Isotropic Gaussian priors are the de facto standard for modern Bayesian neural network inference. However, it is unclear whether these priors accurately reflect our true beliefs ab…
The Gaussian Neural Process
Wessel P. Bruinsma, James Requeima, Andrew Y. K. Foong +2
Neural Processes (NPs; Garnelo et al., 2018a,b) are a rich class of models for meta-learning that map data sets directly to predictive stochastic processes. We provide a rigorous a…
Sparse Gaussian Process Variational Autoencoders
Matthew Ashman, Jonathan So, Will Tebbutt +3
Large, multi-dimensional spatio-temporal datasets are omnipresent in modern science and engineering. An effective framework for handling such data are Gaussian process deep generat…
Meta-Learning Stationary Stochastic Process Prediction with Convolutional Neural Processes
Andrew Y. K. Foong, Wessel P. Bruinsma, Jonathan Gordon +3
Stationary stochastic processes (SPs) are a key component of many probabilistic models, such as those for off-the-grid spatio-temporal data. They enable the statistical symmetry of…
Continual Deep Learning by Functional Regularisation of Memorable Past
Pingbo Pan, Siddharth Swaroop, Alexander Immer +3
Continually learning new skills is important for intelligent systems, yet standard deep learning methods suffer from catastrophic forgetting of the past. Recent works address this…
TaskNorm: Rethinking Batch Normalization for Meta-Learning
John Bronskill, Jonathan Gordon, James Requeima +2
Modern meta-learning approaches for image classification rely on increasingly deep networks to achieve state-of-the-art performance, making batch normalization an essential compone…
Differentially Private Federated Variational Inference
Mrinank Sharma, Michael Hutchinson, Siddharth Swaroop +2
In many real-world applications of machine learning, data are distributed across many clients and cannot leave the devices they are stored on. Furthermore, each client's data, comp…
Continual Learning with Adaptive Weights (CLAW)
Tameem Adel, Han Zhao, Richard E. Turner
Approaches to continual learning aim to successfully learn a set of related tasks that arrive in an online manner. Recently, several frameworks have been developed which enable dee…
Scalable Exact Inference in Multi-Output Gaussian Processes
Wessel P. Bruinsma, Eric Perim, Will Tebbutt +3
Multi-output Gaussian processes (MOGPs) leverage the flexibility and interpretability of GPs while capturing structure across outputs, which is desirable, for example, in spatio-te…
Convolutional Conditional Neural Processes
Jonathan Gordon, Wessel P. Bruinsma, Andrew Y. K. Foong +3
We introduce the Convolutional Conditional Neural Process (ConvCNP), a new member of the Neural Process family that models translation equivariance in the data. Translation equivar…
Independent Subspace Analysis for Unsupervised Learning of Disentangled Representations
Jan Stühmer, Richard E. Turner, Sebastian Nowozin
Recently there has been an increased interest in unsupervised learning of disentangled representations using the Variational Autoencoder (VAE) framework. Most of the existing work…
On the Expressiveness of Approximate Inference in Bayesian Neural Networks
Andrew Y. K. Foong, David R. Burt, Yingzhen Li +1
While Bayesian neural networks (BNNs) hold the promise of being flexible, well-calibrated statistical models, inference often requires approximations whose consequences are poorly…
'In-Between' Uncertainty in Bayesian Neural Networks
Andrew Y. K. Foong, Yingzhen Li, José Miguel Hernández-Lobato +1
We describe a limitation in the expressiveness of the predictive uncertainty estimate given by mean-field variational inference (MFVI), a popular approximate inference method for B…