Extreme data compression while searching for new physics

Abstract

Bringing a high-dimensional dataset into science-ready shape is a formidable challenge that often necessitates data compression. Compression has accordingly become a key consideration for contemporary cosmology, affecting public data releases, and reanalyses searching for new physics. However, data compression optimized for a particular model can suppress signs of new physics, or even remove them altogether. We therefore provide a solution for exploring new physics \emph{during} data compression. In particular, we store additional agnostic compressed data points, selected to enable precise constraints of non-standard physics at a later date. Our procedure is based on the maximal compression of the MOPED algorithm, which optimally filters the data with respect to a baseline model. We select additional filters, based on a generalised principal component analysis, which are carefully constructed to scout for new physics at high precision and speed. We refer to the augmented set of filters as MOPED-PC. They enable an analytic computation of Bayesian evidences that may indicate the presence of new physics, and fast analytic estimates of best-fitting parameters when adopting a specific non-standard theory, without further expensive MCMC analysis. As there may be large numbers of non-standard theories, the speed of the method becomes essential. Should no new physics be found, then our approach preserves the precision of the standard parameters. As a result, we achieve very rapid and maximally precise constraints of standard and non-standard physics, with a technique that scales well to large dimensional datasets.

12 pages, 12 figures. Accepted for publication in MNRAS

References in corpus (18)

• Dark Energy Survey Year 1 Results: Cosmological Constraints from Galaxy Clustering and Weak Lensing
• Cosmology and Fundamental Physics with the Euclid Satellite
• KiDS+VIKING-450: Cosmic shear tomography with optical+infrared data
• Applications of Bayesian model selection to cosmological parameters
• Massive Lossless Data Compression and Multiple Parameter Estimation from Galaxy Spectra
• Parameter inference with estimated covariance matrices
• Fast likelihood-free cosmology with neural density estimators and active learning
• Lensing is Low: Cosmology, Galaxy Formation, or New Physics?
• Automatic physical inference with information maximising neural networks
• Generalized massive optimal data compression
• Bayesian optimisation for likelihood-free cosmological inference
• Recovering Physical Parameters from Galaxy Spectra Using MOPED
• Breaking the spell of Gaussianity: forecasting with higher order Fisher matrices
• Massive data compression for parameter-dependent covariance matrices
• Maximal compression of the redshift space galaxy power spectrum and bispectrum
• Quantifying lost information due to covariance matrix estimation in parameter inference
• A fast, always positive definite and normalizable approximation of non-Gaussian likelihoods
• Extreme data compression for the CMB

Cited by in corpus (10)

• Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections
• Fast and Credible Likelihood-Free Cosmology with Truncated Marginal Neural Ratio Estimation
• The sum of the masses of the Milky Way and M31: a likelihood-free inference approach
• Wavelet Moments for Cosmological Parameter Estimation
• Towards cosmological constraints from the compressed modal bispectrum: a robust comparison of real-space bispectrum estimators
• The impact of signal-to-noise, redshift, and angular range on the bias of weak lensing 2-point functions
• A Simulation Based Inference Approach to the Dynamics of the MW-LMC System -- Validation
• Simulation-based inference has its own Dodelson-Schneider effect (but it knows that it does)
• Identifying the most constraining ice observations to infer molecular binding energies
• Optimal data compression for Lyman-$\alpha$ forest cosmology