4 papers · 1 filter
Drifting Preference Optimization for One-Step Generative Models
Zhou Jiang, Yandong Wen, Zhen Liu
One-step text-to-image generators are attractive for deployment because they generate an image with a single forward pass, but preference finetuning them remains difficult: standar…
Value Gradient Guidance for Flow Matching Alignment
Zhen Liu, Tim Z. Xiao, Carles Domingo-Enrich +2
While methods exist for aligning flow matching models--a popular and effective class of generative models--with human preferences, existing approaches fail to achieve both adaptati…
Flipping Against All Odds: Reducing LLM Coin Flip Bias via Verbalized Rejection Sampling
Tim Z. Xiao, Johannes Zenn, Zhen Liu +3
Large language models (LLMs) can often accurately describe probability distributions using natural language, yet they still struggle to generate faithful samples from them. This mi…
Efficient Diversity-Preserving Diffusion Alignment via Gradient-Informed GFlowNets
Zhen Liu, Tim Z. Xiao, Weiyang Liu +2
While one commonly trains large diffusion models by collecting datasets on target downstream tasks, it is often desired to align and finetune pretrained diffusion models with some…