9 papers
A Minimum Variance Path Principle for Accurate and Stable Score-Based Density Ratio Estimation
Wei Chen, Jiacheng Li, Shigui Li +4
Score-based methods are powerful across machine learning, but they face a paradox: theoretically path-independent, yet practically path-dependent. We resolve this by proving that p…
Towards Disentangled Preference Optimization Dynamics: Suppress the Loser, Preserve the Winner
Wei Chen, Yubing Wu, Junmei Yang +5
Preference optimization is widely used to align large language models (LLMs) with human preferences. However, many margin-based methods also suppress the chosen response when they…
One-Step Score-Based Density Ratio Estimation
Wei Chen, Qibin Zhao, John Paisley +2
Density ratio estimation (DRE) is a useful tool for quantifying discrepancies between probability distributions, but existing approaches often involve a trade-off between estimatio…
Variational Learning of Gaussian Process Latent Variable Models through Stochastic Gradient Annealed Importance Sampling
Jian Xu, Shian Du, Junmei Yang +3
Gaussian Process Latent Variable Models (GPLVMs) have become increasingly popular for unsupervised tasks such as dimensionality reduction and missing data recovery due to their fle…
Fully Bayesian Differential Gaussian Processes through Stochastic Differential Equations
Jian Xu, Zhiqi Lin, Min Chen +3
Deep Gaussian process models typically employ discrete hierarchies, but recent advancements in differential Gaussian processes (DiffGPs) have extended these models to infinite dept…
Diffusion Secant Alignment for Score-Based Density Ratio Estimation
Wei Chen, Shigui Li, Jiacheng Li +6
Estimating density ratios has become increasingly important with the recent rise of score-based and diffusion-inspired methods. However, current tangent-based approaches rely on a…