5 papers
Almost Linear Convergence under Minimal Score Assumptions: Quantized Transition Diffusion
Xunpeng Huang, Yingyu Lin, Nikki Lijing Kuang +4
Continuous diffusion models have demonstrated remarkable performance in data generation across various domains, yet their efficiency remains constrained by two critical limitations…
Multi-Step Consistency Models: Fast Generation with Theoretical Guarantees
Nishant Jain, Xunpeng Huang, Yian Ma +1
Consistency models have recently emerged as a compelling alternative to traditional SDE-based diffusion models. They offer a significant acceleration in generation by producing hig…
What Makes In-context Learning Effective for Mathematical Reasoning: A Theoretical Analysis
Jiayu Liu, Zhenya Huang, Chaokun Wang +3
Owing to the capability of in-context learning, large language models (LLMs) have shown impressive performance across diverse mathematical reasoning benchmarks. However, we find th…
An Improved Analysis of Langevin Algorithms with Prior Diffusion for Non-Log-Concave Sampling
Xunpeng Huang, Hanze Dong, Difan Zou +1
Understanding the dimension dependency of computational complexity in high-dimensional sampling problem is a fundamental problem, both from a practical and theoretical perspective.…
Faster Sampling without Isoperimetry via Diffusion-based Monte Carlo
Xunpeng Huang, Difan Zou, Hanze Dong +2
To sample from a general target distribution beyond the isoperimetric condition, Huang et al. (2023) proposed to perform sampling through reverse diffusion, g…