7 papers
Variational Test-time Optimization for Diffusion Synchronization
Hyunsoo Lee, Farrin Marouf Sofian, Kushagra Pandey +1
Collaborative generation, which coordinates multiple diffusion trajectories to extend the capabilities of pretrained priors, has emerged as a powerful paradigm for extending the ap…
Hierarchical Variational Policies for Reward-Guided Diffusion
Kushagra Pandey, Farrin Marouf Sofian, Jan Niklas Groeneveld +2
Adapting pretrained diffusion models to downstream objectives such as inverse problems often requires expensive test-time guidance or optimization. We propose a principled framewor…
Control-Augmented Autoregressive Diffusion for Data Assimilation
Prakhar Srivastava, Farrin Marouf Sofian, Francesco Immorlano +2
Despite advances in test-time scaling and diffusion finetuning, guidance for Auto-Regressive Diffusion Models (ARDMs) remains underexplored. We introduce an amortized framework tha…
On the Challenges and Opportunities in Generative AI
Laura Manduchi, Clara Meister, Kushagra Pandey +23
The field of deep generative modeling has grown rapidly in the last few years. With the availability of massive amounts of training data coupled with advances in scalable unsupervi…
Variational Control for Guidance in Diffusion Models
Kushagra Pandey, Farrin Marouf Sofian, Felix Draxler +2
Diffusion models exhibit excellent sample quality, but existing guidance methods often require additional model training or are limited to specific tasks. We revisit guidance in di…
Fast Samplers for Inverse Problems in Iterative Refinement Models
Kushagra Pandey, Ruihan Yang, Stephan Mandt
Constructing fast samplers for unconditional diffusion and flow-matching models has received much attention recently; however, existing methods for solving inverse problems, such a…