6 papers · 1 filter
Sampling from Energy distributions with Target Concrete Score Identity
Sergei Kholkin, Francisco Vargas, Alexander Korotin
We introduce the Target Concrete Score Identity Sampler (TCSIS), a method for sampling from unnormalized densities on discrete state spaces by learning the reverse dynamics of a Co…
CREPE: Controlling Diffusion with Replica Exchange
Jiajun He, Paul Jeha, Peter Potaptchik +5
Inference-time control of diffusion models aims to steer model outputs to satisfy new constraints without retraining. Previous approaches have mostly relied on heuristic guidance o…
Path Integral Optimiser: Global Optimisation via Neural Schrödinger-Föllmer Diffusion
Max McGuinness, Eirik Fladmark, Francisco Vargas
We present an early investigation into the use of neural diffusion processes for global optimisation, focusing on Zhang et al.'s Path Integral Sampler. One can use the Boltzmann di…
RNE: plug-and-play diffusion inference-time control and energy-based training
Jiajun He, José Miguel Hernández-Lobato, Yuanqi Du +1
Diffusion models generate data by removing noise gradually, which corresponds to the time-reversal of a noising process. However, access to only the denoising kernels is often insu…
Accelerated Parallel Tempering via Neural Transports
Leo Zhang, Peter Potaptchik, Jiajun He +5
Markov Chain Monte Carlo (MCMC) algorithms are essential tools in computational statistics for sampling from unnormalised probability distributions, but can be fragile when targeti…
Debiasing Guidance for Discrete Diffusion with Sequential Monte Carlo
Cheuk Kit Lee, Paul Jeha, Jes Frellsen +3
Discrete diffusion models are a class of generative models that produce samples from an approximated data distribution within a discrete state space. Often, there is a need to targ…