5 papers
Efficient Parametric SVD of Koopman Operator for Stochastic Dynamical Systems
Minchan Jeong, J. Jon Ryu, Se-Young Yun +1
The Koopman operator provides a principled framework for analyzing nonlinear dynamical systems through linear operator theory. Recent advances in dynamic mode decomposition (DMD) h…
Contrastive Predictive Coding Done Right for Mutual Information Estimation
J. Jon Ryu, Pavan Yeddanapudi, Xiangxiang Xu +1
The InfoNCE objective, originally introduced for contrastive representation learning, has become a popular choice for mutual information (MI) estimation, despite its indirect conne…
Revisiting Orbital Minimization Method for Neural Operator Decomposition
J. Jon Ryu, Samuel Zhou, Gregory W. Wornell
Spectral decomposition of linear operators plays a central role in many areas of machine learning and scientific computing. Recent work has explored training neural networks to app…
Score-of-Mixture Training: Training One-Step Generative Models Made Simple via Score Estimation of Mixture Distributions
Tejas Jayashankar, J. Jon Ryu, Gregory Wornell
We propose Score-of-Mixture Training (SMT), a novel framework for training one-step generative models by minimizing a class of divergences called the -skew Jensen--Shannon dive…
A Unified View on Learning Unnormalized Distributions via Noise-Contrastive Estimation
J. Jon Ryu, Abhin Shah, Gregory W. Wornell
This paper studies a family of estimators based on noise-contrastive estimation (NCE) for learning unnormalized distributions. The main contribution of this work is to provide a un…