222 citations · 961 across the 42 of their papers we have counts for
43 papers
Beckmann Transport Models: From Autonomous Flows to One-Step Maps
Lee Cheuk-Kit, Florentin Coeurdoux, Yuyuan Chen +5
We propose an instantiation of flow matching that relies on a time-independent velocity field (an \emph{autonomous flow}) to exactly map between two distributions, so long as the t…
Itô maps for any-step SDEs
Zhengkai Pan, Peter Potaptchik, Wenxi Yao +2
Recent one-step generative models accelerate sampling by learning deterministic flow maps of the underlying dynamics. These methods rely on learning from ordinary differential equa…
Discrete Tilt Matching
Yuyuan Chen, Shiyi Wang, Peter Potaptchik +2
Masked diffusion large language models (dLLMs) are a promising alternative to autoregressive generation. While reinforcement learning (RL) methods have recently been adapted to dLL…
A unified perspective on fine-tuning and sampling with diffusion and flow models
Carles Domingo-Enrich, Yuanqi Du, Michael S. Albergo
We study the problem of training diffusion and flow generative models to sample from target distributions defined by an exponential tilting of a base density; a formulation that su…
Discrete Flow Maps
Peter Potaptchik, Jason Yim, Adhi Saravanan +3
The sequential nature of autoregressive next-token prediction imposes a fundamental speed limit on large language models. While continuous flow models offer a path to parallel gene…
Graph Energy Matching: Transport-Aligned Energy-Based Modeling for Graph Generation
Michal Balcerak, Suprosanna Shit, Chinmay Prabhakar +4
Generative modeling of discrete data, such as graphs, underpins many scientific and industrial applications, including molecular discovery and materials design. In these domains, p…
A Monte Carlo estimator of flow fields for sampling and noise problems
Michael S. Albergo, Gurtej Kanwar
Learned field transformations may help address ubiquitous critical slowing down and signal-to-noise problems in lattice field theory. In the context of an annealed sequence of dist…
Meta Flow Maps enable scalable reward alignment
Peter Potaptchik, Adhi Saravanan, Abbas Mammadov +3
Controlling generative models is computationally expensive. This is because optimal alignment with a reward function--whether via inference-time steering or fine-tuning--requires e…
Tilt Matching for Scalable Sampling and Fine-Tuning
Peter Potaptchik, Cheuk-Kit Lee, Michael S. Albergo
We propose a simple, scalable algorithm for using stochastic interpolants to sample from unnormalized densities and for fine-tuning generative models. The approach, Tilt Matching,…
Test-time scaling of diffusions with flow maps
Amirmojtaba Sabour, Michael S. Albergo, Carles Domingo-Enrich +4
A common recipe to improve diffusion models at test-time so that samples score highly against a user-specified reward is to introduce the gradient of the reward into the dynamics o…
DASIP: Dynamic Test-Time Compute Scaling for Robot Control with Stochastic Interpolant Policies
Inkook Chun, Seungjae Lee, Michael S. Albergo +2
Diffusion- and flow-based policies deliver state-of-the-art performance on long-horizon robotic manipulation and imitation learning tasks. However, these controllers employ a fixed…
Generalised Flow Maps for Few-Step Generative Modelling on Riemannian Manifolds
Oscar Davis, Michael S. Albergo, Nicholas M. Boffi +2
Geometric data and purpose-built generative models on them have become ubiquitous in high-impact deep learning application domains, ranging from protein backbone generation and com…
Any-Order Flexible Length Masked Diffusion
Jaeyeon Kim, Lee Cheuk-Kit, Carles Domingo-Enrich +5
Masked diffusion models (MDMs) have recently emerged as a promising alternative to autoregressive models over discrete domains. MDMs generate sequences in an any-order, parallel fa…
Multitask Learning with Stochastic Interpolants
Hugo Negrel, Florentin Coeurdoux, Michael S. Albergo +1
We propose a framework for learning maps between probability distributions that broadly generalizes the time dynamics of flow and diffusion models. To enable this, we generalize st…
How to build a consistency model: Learning flow maps via self-distillation
Nicholas M. Boffi, Michael S. Albergo, Eric Vanden-Eijnden
Flow-based generative models achieve state-of-the-art sample quality, but require the expensive solution of a differential equation at inference time. Flow map models, commonly kno…
LEAPS: A discrete neural sampler via locally equivariant networks
Peter Holderrieth, Michael S. Albergo, Tommi Jaakkola
We propose "LEAPS", an algorithm to sample from discrete distributions known up to normalization by learning a rate matrix of a continuous-time Markov chain (CTMC). LEAPS can be se…
Debiasing Guidance for Discrete Diffusion with Sequential Monte Carlo
Cheuk Kit Lee, Paul Jeha, Jes Frellsen +3
Discrete diffusion models are a class of generative models that produce samples from an approximated data distribution within a discrete state space. Often, there is a need to targ…
Strange metals and planckian transport in a gapless phase from spatially random interactions
Aavishkar A. Patel, Peter Lunts, Michael S. Albergo
`Strange' metals that do not follow the predictions of Fermi liquid theory are prevalent in materials that feature superconductivity arising from electron interactions. In recent y…
NETS: A Non-Equilibrium Transport Sampler
Michael S. Albergo, Eric Vanden-Eijnden
We propose an algorithm, termed the Non-Equilibrium Transport Sampler (NETS), to sample from unnormalized probability distributions. NETS can be viewed as a variant of annealed imp…
Flow map matching with stochastic interpolants: A mathematical framework for consistency models
Nicholas M. Boffi, Michael S. Albergo, Eric Vanden-Eijnden
Generative models based on dynamical equations such as flows and diffusions offer exceptional sample quality, but require computationally expensive numerical integration during inf…
Practical applications of machine-learned flows on gauge fields
Ryan Abbott, Michael S. Albergo, Denis Boyda +5
Normalizing flows are machine-learned maps between different lattice theories which can be used as components in exact sampling and inference schemes. Ongoing work yields increasin…
Multiscale Normalizing Flows for Gauge Theories
Ryan Abbott, Michael S. Albergo, Denis Boyda +5
Scale separation is an important physical principle that has previously enabled algorithmic advances such as multigrid solvers. Previous work on normalizing flows has been able to…
Probabilistic Forecasting with Stochastic Interpolants and Föllmer Processes
Yifan Chen, Mark Goldstein, Mengjian Hua +3
We propose a framework for probabilistic forecasting of dynamical systems based on generative modeling. Given observations of the system state over time, we formulate the forecasti…
SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers
Nanye Ma, Mark Goldstein, Michael S. Albergo +3
We present Scalable Interpolant Transformers (SiT), a family of generative models built on the backbone of Diffusion Transformers (DiT). The interpolant framework, which allows for…