10 papers
Structured Inference with Large Language Gibbs
Sanghyeok Choi, Henry Gouk, Esmeralda S. Whitammer
The knowledge encoded in large language models (LLMs) can serve as a substrate for structured reasoning over variables describing a complex world, but accessing this knowledge in a…
Reinforced sequential Monte Carlo for amortised sampling
Sanghyeok Choi, Sarthak Mittal, VÃctor Elvira +2
This paper proposes a synergy of amortised and particle-based methods for sampling from distributions defined by unnormalised density functions. We state a connection between seque…
Discrete diffusion samplers and bridges: Off-policy algorithms and applications in latent spaces
Arran Carter, Sanghyeok Choi, Kirill Tamogashev +2
Sampling from a distribution known up to a normalising constant is an important and challenging problem in statistics. Recent years have seen the…
Aligning Few-Step Generative Models by Amortizing Sample-based Variational Inference
Jaewoo Lee, Hyeongyu Kang, Dohyun Kim +9
Aligning a few-step generative model is challenging, since existing alignment frameworks typically rely on restrictive assumptions: a tractable likelihood, a specific ODE/SDE solve…
Diffusion Alignment as Variational Expectation-Maximization
Jaewoo Lee, Minsu Kim, Sanghyeok Choi +7
Diffusion alignment aims to optimize diffusion models for the downstream objective. While existing methods based on reinforcement learning or direct backpropagation achieve conside…
Neural Genetic Search in Discrete Spaces
Hyeonah Kim, Sanghyeok Choi, Jiwoo Son +2
Effective search methods are crucial for improving the performance of deep generative models at test time. In this paper, we introduce a novel test-time search method, Neural Genet…