6 papers · 1 filter
Reinforcement Learning without Ground-Truth Solutions can Improve LLMs
Yingyu Lin, Qiyue Gao, Nikki Lijing Kuang +6
Reinforcement learning with verifiable rewards (RLVR) for training LLMs typically rely on ground-truth answers to assign rewards, limiting their applicability to tasks where the gr…
Latent Shadows: The Gaussian-Discrete Duality in Masked Diffusion
Guinan Chen, Xunpeng Huang, Ying Sun +3
Masked discrete diffusion is a dominant paradigm for high-quality language modeling where tokens are iteratively corrupted to a mask state, yet its inference efficiency is bottlene…
On the -Free Inference Complexity of Absorbing Discrete Diffusion
Xunpeng Huang, Yingyu Lin, Nishant Jain +4
Absorbing discrete diffusion has emerged as a dominant framework for discrete data generation. However, a significant disparity remains between its empirical success and theoretica…
Multi-Step Consistency Models: Fast Generation with Theoretical Guarantees
Nishant Jain, Xunpeng Huang, Yian Ma +1
Consistency models have recently emerged as a compelling alternative to traditional SDE-based diffusion models. They offer a significant acceleration in generation by producing hig…
Capturing Conditional Dependence via Auto-regressive Diffusion Models
Xunpeng Huang, Yujin Han, Difan Zou +2
Diffusion models have demonstrated appealing performance in both image and video generation. However, many works discover that they struggle to capture important, high-level relati…
An Improved Analysis of Langevin Algorithms with Prior Diffusion for Non-Log-Concave Sampling
Xunpeng Huang, Hanze Dong, Difan Zou +1
Understanding the dimension dependency of computational complexity in high-dimensional sampling problem is a fundamental problem, both from a practical and theoretical perspective.…