6 papers
Learn to Guide Your Diffusion Model
Alexandre Galashov, Ashwini Pokle, Arnaud Doucet +3
Classifier-free guidance (CFG) is a widely used technique for improving the perceptual quality of samples from conditional diffusion models. It operates by linearly combining condi…
Progressive Inference-Time Annealing of Diffusion Models for Sampling from Boltzmann Densities
Tara Akhound-Sadegh, Jungyoon Lee, Avishek Joey Bose +7
Sampling efficiently from a target unnormalized probability density remains a core challenge, with relevance across countless high-impact scientific applications. A promising appro…
Feynman-Kac Correctors in Diffusion: Annealing, Guidance, and Product of Experts
Marta Skreta, Tara Akhound-Sadegh, Viktor Ohanesian +6
While score-based generative models are the model of choice across diverse domains, there are limited tools available for controlling inference-time behavior in a principled manner…
Distributional Diffusion Models with Scoring Rules
Valentin De Bortoli, Alexandre Galashov, J. Swaroop Guntupalli +4
Diffusion models generate high-quality synthetic data. They operate by defining a continuous-time forward process which gradually adds Gaussian noise to data until fully corrupted.…
Accelerated Diffusion Models via Speculative Sampling
Valentin De Bortoli, Alexandre Galashov, Arthur Gretton +1
Speculative sampling is a popular technique for accelerating inference in Large Language Models by generating candidate tokens using a fast draft model and accepting or rejecting t…
Schrödinger Bridge Flow for Unpaired Data Translation
Valentin De Bortoli, Iryna Korshunova, Andriy Mnih +1
Mass transport problems arise in many areas of machine learning whereby one wants to compute a map transporting one distribution to another. Generative modeling techniques like Gen…