7 papers
Multi-Objective Learning for Diffusion Models: A Statistical Theory under Semi-Supervised Learning
Ziheng Cheng, Yixiao Huang, Hanlin Zhu +5
Diffusion models are increasingly used as powerful conditional generators, yet real deployments often involve multiple target distributions arising from different tasks, e.g., dive…
A Kernel Approach for Semi-implicit Variational Inference
Longlin Yu, Ziheng Cheng, Shiyue Zhang +1
Semi-implicit variational inference (SIVI) enhances the expressiveness of variational families through hierarchical semi-implicit distributions, but the intractability of their den…
Provable Sample-Efficient Transfer Learning Conditional Diffusion Models via Representation Learning
Ziheng Cheng, Tianyu Xie, Shiyue Zhang +1
While conditional diffusion models have achieved remarkable success in various applications, they require abundant data to train from scratch, which is often infeasible in practice…
Semi-Implicit Functional Gradient Flow for Efficient Sampling
Shiyue Zhang, Ziheng Cheng, Cheng Zhang
Particle-based variational inference methods (ParVIs) use nonparametric variational families represented by particles to approximate the target distribution according to the kernel…
Functional Gradient Flows for Constrained Sampling
Shiyue Zhang, Longlin Yu, Ziheng Cheng +1
Recently, through a unified gradient flow perspective of Markov chain Monte Carlo (MCMC) and variational inference (VI), particle-based variational inference methods (ParVIs) have…
Kernel Semi-Implicit Variational Inference
Ziheng Cheng, Longlin Yu, Tianyu Xie +2
Semi-implicit variational inference (SIVI) extends traditional variational families with semi-implicit distributions defined in a hierarchical manner. Due to the intractable densit…