7 papers
SwiftExplorer: Training-free Diffusion Model Alignment with Swift Diversity Exploration
Renye Yan, Jikang Cheng, You Wu +5
Diffusion models have general generative abilities but struggle to align with specific objectives. Fine-tuning can improve alignment, yet its training cost is often prohibitive. Th…
Can We Perform Online RL for Image Editing without Editing Rewards?
Qichao Ma, Jikang Cheng, Ling Liang +3
Reinforcement learning (RL) enables direct preference optimization for image editing through editing-specific rewards, which remain less developed due to costly triplet supervision…
Pixel-Space Diffusion Transformers
Renye Yan, Jikang Cheng, You Wu +8
Latent diffusion models (LDMs) enable efficient high-resolution image synthesis by denoising in a VAE-compressed latent space. However, fixed visual tokenizers can discard fine tex…
PAST: Prompt-Adaptive Sampling Termination for Efficient Diffusion Model
Renye Yan, Jikang Cheng, You Wu +4
While diffusion models have made significant progress in text-to-image tasks, they still exhibit limitations when directly optimizing downstream objectives. Although Reinforcement…
Explore or Converge? Stage-Guided Per-Step Optimization for Diffusion Models
Renye Yan, Jikang Cheng, You Wu +4
Diffusion models have strong generative capabilities. However, their maximum likelihood training objective only focuses on reconstructing the data distribution, making it difficult…
Do Less, Achieve More: Do We Need Every-Step Optimization for RL Fine-tuning of Diffusion Models?
Renye Yan, Jikang Cheng, Shikun Sun +7
Despite strong image-generation performance, diffusion models' reconstruction objectives limit alignment with human preferences. RL enables such alignment through explicit rewards.…