Stochastic determination of matrix determinants

Abstract

Matrix determinants play an important role in data analysis, in particular when Gaussian processes are involved. Due to currently exploding data volumes, linear operations - matrices - acting on the data are often not accessible directly but are only represented indirectly in form of a computer routine. Such a routine implements the transformation a data vector undergoes under matrix multiplication. While efficient probing routines to estimate a matrix's diagonal or trace, based solely on such computationally affordable matrix-vector multiplications, are well known and frequently used in signal inference, there is no stochastic estimate for its determinant. We introduce a probing method for the logarithm of a determinant of a linear operator. Our method rests upon a reformulation of the log-determinant by an integral representation and the transformation of the involved terms into stochastic expressions. This stochastic determinant determination enables large-size applications in Bayesian inference, in particular evidence calculations, model comparison, and posterior determination.

arXiv comment8 pages, 5 figures

References in corpus (19)

• The Sloan Digital Sky Survey: Technical Summary
• Wilkinson Microwave Anisotropy Probe (WMAP) Three Year Results: Implications for Cosmology
• Planck 2013 results. XVI. Cosmological parameters
• MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physics
• Nine-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Final Maps and Results
• Planck 2013 results. XXII. Constraints on inflation
• Bayesian physical reconstruction of initial conditions from large scale structure surveys
• The Best Inflationary Models After Planck
• Measuring primordial non-Gaussianity in the cosmic microwave background
• Analyzing weak lensing of the cosmic microwave background using the likelihood function
• Bayesian reconstruction of the cosmological large-scale structure: methodology, inverse algorithms and numerical optimization
• Analytic marginalization over CMB calibration and beam uncertainty
• NIFTY - Numerical Information Field Theory - a versatile Python library for signal inference
• Reconstruction of signals with unknown spectra in information field theory with parameter uncertainty
• Generic inference of inflation models by non-Gaussianity and primordial power spectrum reconstruction
• Improving stochastic estimates with inference methods: calculating matrix diagonals
• Improving self-calibration
• Fast and precise way to calculate the posterior for the local non-Gaussianity parameter $f_{\text{nl}}$ from cosmic microwave background observations
• Signal inference with unknown response: Calibration-uncertainty renormalized estimator

Cited by in corpus (4)

• Large-scale Log-determinant Computation through Stochastic Chebyshev Expansions
• Optimal constraints on primordial gravitational waves from the lensed CMB
• Quantum algorithms for spectral sums
• Kernel-Matrix Determinant Estimates from stopped Cholesky Decomposition