143 citations · 179 across the 11 of their papers we have counts for
6 papers · 1 filter
ADMIRE-BayesOpt: Accelerated Data MIxture RE-weighting for Language Models with Bayesian Optimization
Shengzhuang Chen, Xu Ouyang, Michael Arthur Leopold Pearce +2
Determining the optimal data mixture for large language model training remains a challenging problem with an outsized impact on performance. In practice, language model developers…
Factorized Gaussian Process Variational Autoencoders
Metod Jazbec, Michael Pearce, Vincent Fortuin
Variational autoencoders often assume isotropic Gaussian priors and mean-field posteriors, hence do not exploit structure in scenarios where we may expect similarity or consistency…
Sparse Gaussian Process Variational Autoencoders
Matthew Ashman, Jonathan So, Will Tebbutt +3
Large, multi-dimensional spatio-temporal datasets are omnipresent in modern science and engineering. An effective framework for handling such data are Gaussian process deep generat…
Scalable Gaussian Process Variational Autoencoders
Metod Jazbec, Matthew Ashman, Vincent Fortuin +3
Conventional variational autoencoders fail in modeling correlations between data points due to their use of factorized priors. Amortized Gaussian process inference through GP-VAEs…
Practical Bayesian Optimization of Objectives with Conditioning Variables
Michael Pearce, Janis Klaise, Matthew Groves
Bayesian optimization is a class of data efficient model based algorithms typically focused on global optimization. We consider the more general case where a user is faced with mul…
Bayesian Optimization Allowing for Common Random Numbers
Michael Pearce, Matthias Poloczek, Juergen Branke
Bayesian optimization is a powerful tool for expensive stochastic black-box optimization problems such as simulation-based optimization or machine learning hyperparameter tuning. M…