6 papers · 1 filter
Discrete Flow Maps
Peter Potaptchik, Jason Yim, Adhi Saravanan +3
The sequential nature of autoregressive next-token prediction imposes a fundamental speed limit on large language models. While continuous flow models offer a path to parallel gene…
Tilt Matching for Scalable Sampling and Fine-Tuning
Peter Potaptchik, Cheuk-Kit Lee, Michael S. Albergo
We propose a simple, scalable algorithm for using stochastic interpolants to sample from unnormalized densities and for fine-tuning generative models. The approach, Tilt Matching,…
Schrödinger Bridge Matching for Tree-Structured Costs and Entropic Wasserstein Barycentres
Samuel Howard, Peter Potaptchik, George Deligiannidis
Recent advances in flow-based generative modelling have provided scalable methods for computing the Schrödinger Bridge (SB) between distributions, a dynamic form of entropy-regular…
Adaptive Diffusion Guidance via Stochastic Optimal Control
Iskander Azangulov, Peter Potaptchik, Qinyu Li +3
Guidance is a cornerstone of modern diffusion models, playing a pivotal role in conditional generation and enhancing the quality of unconditional samples. However, current approach…
Accelerated Parallel Tempering via Neural Transports
Leo Zhang, Peter Potaptchik, Jiajun He +5
Markov Chain Monte Carlo (MCMC) algorithms are essential tools in computational statistics for sampling from unnormalised probability distributions, but can be fragile when targeti…
Linear Convergence of Diffusion Models Under the Manifold Hypothesis
Peter Potaptchik, Iskander Azangulov, George Deligiannidis
Score-matching generative models have proven successful at sampling from complex high-dimensional data distributions. In many applications, this distribution is believed to concent…