14 citations · 14 across the 8 of their papers we have counts for
8 papers · 1 filter
Introduction to Stochastic Differential Equations for Generative Machine Learning: A Variational Perspective
Ole Winther, Paul Jeha, Sander Dieleman +3
The use of ordinary and stochastic differential equations has led to substantial progress in generative machine learning with applications to, for example, image, video and biomole…
Mix, Don't Tune: Bilingual Pre-Training Outperforms Hyperparameter Search in Data-Constrained Settings
Paul Jeha, Anastasiia Sedova, Louis Béthune +4
For most languages of the world, language model pre-training operates in a data-constrained regime where models must repeat their training data many times, degrading generalization…
CREPE: Controlling Diffusion with Replica Exchange
Jiajun He, Paul Jeha, Peter Potaptchik +5
Inference-time control of diffusion models aims to steer model outputs to satisfy new constraints without retraining. Previous approaches have mostly relied on heuristic guidance o…
Learning Energy-Based Models by Self-normalising the Likelihood
Hugo Senetaire, Paul Jeha, Pierre-Alexandre Mattei +1
Training an energy-based model (EBM) with maximum likelihood is challenging due to the intractable normalisation constant. Traditional methods rely on expensive Markov chain Monte…
Debiasing Guidance for Discrete Diffusion with Sequential Monte Carlo
Cheuk Kit Lee, Paul Jeha, Jes Frellsen +3
Discrete diffusion models are a class of generative models that produce samples from an approximated data distribution within a discrete state space. Often, there is a need to targ…
Generative Diffusion Models for Sequential Recommendations
Sharare Zolghadr, Ole Winther, Paul Jeha
Generative models such as Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs) have shown promise in sequential recommendation tasks. However, they face chall…
Variance reduction of diffusion model's gradients with Taylor approximation-based control variate
Paul Jeha, Will Grathwohl, Michael Riis Andersen +2
Score-based models, trained with denoising score matching, are remarkably effective in generating high dimensional data. However, the high variance of their training objective hind…
PSA-GAN: Progressive Self Attention GANs for Synthetic Time Series
Jeha Paul, Bohlke-Schneider Michael, Mercado Pedro +5
Realistic synthetic time series data of sufficient length enables practical applications in time series modeling tasks, such as forecasting, but remains a challenge. In this paper…