7 papers · 1 filter
Generalized Guarantees for Variational Inference in the Presence of Even and Elliptical Symmetry
Charles C. Margossian, Isaac E. Rankin, Lawrence K. Saul
Variational inference (VI) approximates a target density by the best match in a family of tractable distributions. The best variational approximation is found by minimizing…
Variational Inference in Location-Scale Families: Exact Recovery of the Mean and Correlation Matrix
Charles C. Margossian, Lawrence K. Saul
Given an intractable target density , variational inference (VI) attempts to find the best approximation from a tractable family . This is typically done by minimizing th…
Fisher meets Feynman: score-based variational inference with a product of experts
Diana Cai, Robert M. Gower, David M. Blei +1
We introduce a highly expressive yet distinctly tractable family for black-box variational inference (BBVI). Each member of this family is a weighted product of experts (PoE), and…
Variational Inference for Uncertainty Quantification: an Analysis of Trade-offs
Charles C. Margossian, Loucas Pillaud-Vivien, Lawrence K. Saul
Given an intractable distribution , the problem of variational inference (VI) is to find the best approximation from some more tractable family . Commonly, one chooses to…
Batch, match, and patch: low-rank approximations for score-based variational inference
Chirag Modi, Diana Cai, Lawrence K. Saul
Black-box variational inference (BBVI) scales poorly to high-dimensional problems when it is used to estimate a multivariate Gaussian approximation with a full covariance matrix. I…
EigenVI: score-based variational inference with orthogonal function expansions
Diana Cai, Chirag Modi, Charles C. Margossian +3
We develop EigenVI, an eigenvalue-based approach for black-box variational inference (BBVI). EigenVI constructs its variational approximations from orthogonal function expansions.…