Bayesian Inference over the Stiefel Manifold via the Givens Representation

Abstract

We introduce an approach based on the Givens representation for posterior inference in statistical models with orthogonal matrix parameters, such as factor models and probabilistic principal component analysis (PPCA). We show how the Givens representation can be used to develop practical methods for transforming densities over the Stiefel manifold into densities over subsets of Euclidean space. We show how to deal with issues arising from the topology of the Stiefel manifold and how to inexpensively compute the change-of-measure terms. We introduce an auxiliary parameter approach that limits the impact of topological issues. We provide both analysis of our methods and numerical examples demonstrating the effectiveness of the approach. We also discuss how our Givens representation can be used to define general classes of distributions over the space of orthogonal matrices. We then give demonstrations on several examples showing how the Givens approach performs in practice in comparison with other methods.

References in corpus (5)

• Sparsity information and regularization in the horseshoe and other shrinkage priors
• Edward: A library for probabilistic modeling, inference, and criticism
• 2D Bayesian automated tilted-ring fitting of disk galaxies in large HI galaxy surveys: 2DBAT
• Bayesian Inference on Matrix Manifolds for Linear Dimensionality Reduction
• Models of random sparse eigenmatrices matrices and Bayesian analysis of multivariate structure

Cited by in corpus (3)

• Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Users
• Enforcing stationarity through the prior in vector autoregressions
• MM-PCA: Integrative Analysis of Multi-group and Multi-view Data