A Parameter-Masked Mock Data Challenge for Beyond-Two-Point Galaxy Clustering Statistics

Abstract

The last few years have seen the emergence of a wide array of novel techniques for analyzing high-precision data from upcoming galaxy surveys, which aim to extend the statistical analysis of galaxy clustering data beyond the linear regime and the canonical two-point (2pt) statistics. We test and benchmark some of these new techniques in a community data challenge "Beyond-2pt", initiated during the Aspen 2022 Summer Program "Large-Scale Structure Cosmology beyond 2-Point Statistics," whose first round of results we present here. The challenge dataset consists of high-precision mock galaxy catalogs for clustering in real space, redshift space, and on a light cone. Participants in the challenge have developed end-to-end pipelines to analyze mock catalogs and extract unknown ("masked") cosmological parameters of the underlying $\Lambda$CDM models with their methods. The methods represented are density-split clustering, nearest neighbor statistics, BACCO power spectrum emulator, void statistics, LEFTfield field-level inference using effective field theory (EFT), and joint power spectrum and bispectrum analyses using both EFT and simulation-based inference. In this work, we review the results of the challenge, focusing on problems solved, lessons learned, and future research needed to perfect the emerging beyond-2pt approaches. The unbiased parameter recovery demonstrated in this challenge by multiple statistics and the associated modeling and inference frameworks supports the credibility of cosmology constraints from these methods. The challenge data set is publicly available and we welcome future submissions from methods that are not yet represented.

Matched ApJ accepted version. New submissions welcome! Challenge data available at https://github.com/ANSalcedo/Beyond2ptMock

References in corpus (202)

• Planck 2015 results. XIII. Cosmological parameters
• MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physics
• dynesty: A Dynamic Nested Sampling Package for Estimating Bayesian Posteriors and Evidences
• The Baryon Oscillation Spectroscopic Survey of SDSS-III
• Multimodal nested sampling: an efficient and robust alternative to MCMC methods for astronomical data analysis
• The Rockstar Phase-Space Temporal Halo Finder and the Velocity Offsets of Cluster Cores
• The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: Cosmological Implications from two Decades of Spectroscopic Surveys at the Apache Point observatory
• UniverseMachine: The Correlation between Galaxy Growth and Dark Matter Halo Assembly from z=0-10
• DESI 2024 VI: Cosmological Constraints from the Measurements of Baryon Acoustic Oscillations
• Importance Nested Sampling and the MultiNest Algorithm
• Cold dark matter haloes in the Planck era: evolution of structural parameters for Einasto and NFW profiles
• Theoretical Models of the Halo Occupation Distribution: Separating Central and Satellite Galaxies
• Why your model parameter confidences might be too optimistic -- unbiased estimation of the inverse covariance matrix
• Large-Scale Galaxy Bias
• The Connection between Galaxies and their Dark Matter Halos
• Extragalactic Science, Cosmology and Galactic Archaeology with the Subaru Prime Focus Spectrograph (PFS)
• Transients from Initial Conditions in Cosmological Simulations
• Cosmological Non-Linearities as an Effective Fluid
• The Effective Field Theory of Cosmological Large Scale Structures
• Galaxy Evolution from Halo Occupation Distribution Modeling of DEEP2 and SDSS Galaxy Clustering
• Redshift-Space Distortions, Pairwise Velocities and Nonlinearities
• Nonlinear Evolution of Baryon Acoustic Oscillations
• The Cosmological Analysis of the SDSS/BOSS data from the Effective Field Theory of Large-Scale Structure
• Cosmological Parameters from the BOSS Galaxy Power Spectrum
• Baryon Acoustic Oscillations in 2D: Modeling Redshift-space Power Spectrum from Perturbation Theory
• ZOBOV: a parameter-free void-finding algorithm
• The clustering of galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: RSD measurement from the power spectrum and bispectrum of the DR12 BOSS galaxies
• The Quijote simulations
• The clustering of galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: mock galaxy catalogues for the BOSS Final Data Release
• emcee v3: A Python ensemble sampling toolkit for affine-invariant MCMC
• A Cosmic Watershed: the WVF Void Detection Technique
• The Uchuu Simulations: Data Release 1 and Dark Matter Halo Concentrations
• nbodykit: an open-source, massively parallel toolkit for large-scale structure
• The FLAMINGO project: cosmological hydrodynamical simulations for large-scale structure and galaxy cluster surveys
• Nonlinear perturbation theory with halo bias and redshift-space distortions via the Lagrangian picture
• The IR-resummed Effective Field Theory of Large Scale Structures
• Precision cosmography with stacked voids
• AbacusSummit: A Massive Set of High-Accuracy, High-Resolution $N$-Body Simulations
• Fast likelihood-free cosmology with neural density estimators and active learning
• Equivalence Principle and the Baryon Acoustic Peak
• Non-linear perturbation theory extension of the Boltzmann code CLASS
• Fast Estimators for Redshift-Space Clustering
• A 2.5% measurement of the growth rate from small-scale redshift space clustering of SDSS-III CMASS galaxies
• Dark Quest. I. Fast and Accurate Emulation of Halo Clustering Statistics and Its Application to Galaxy Clustering
• The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: cosmological implications of the configuration-space clustering wedges
• The BACCO Simulation Project: Exploiting the full power of large-scale structure for cosmology
• Time-Sliced Perturbation Theory II: Baryon Acoustic Oscillations and Infrared Resummation
• Universal Density Profile for Cosmic Voids
• Mock galaxy catalogs using the quick particle mesh method
• Constraints on Cosmology and Gravity from the Dynamics of Voids
• A new analysis of galaxy 2-point functions in the BOSS survey, including full-shape information and post-reconstruction BAO
• Blinded challenge for precision cosmology with large-scale structure: results from effective field theory for the redshift-space galaxy power spectrum
• Introducing Decorated HODs: modeling assembly bias in the galaxy-halo connection
• Counting voids to probe dark energy
• Cosmological Parameters and Neutrino Masses from the Final Planck and Full-Shape BOSS Data
• The abundance of voids and the excursion set formalism
• Infrared Resummation for Biased Tracers in Redshift Space
• Implementation and performance of FDPS: A Framework Developing Parallel Particle Simulation Codes
• One simulation to fit them all - changing the background parameters of a cosmological N-body simulation
• Redshift-Space Distortions in Lagrangian Perturbation Theory
• Hydrodynamical simulations of the galaxy population: enduring successes and outstanding challenges
• A first application of the Alcock-Paczynski test to stacked cosmic voids
• Consistent Modeling of Velocity Statistics and Redshift-Space Distortions in One-Loop Perturbation Theory
• Measuring neutrino masses with large-scale structure: Euclid forecast with controlled theoretical error
• Modeling Biased Tracers at the Field Level
• Probing cosmology and gravity with redshift-space distortions around voids
• Likelihood-free inference with neural compression of DES SV weak lensing map statistics
• GreeM : Massively Parallel TreePM Code for Large Cosmological N-body Simulations
• Velocity Bias from the Small Scale Clustering of SDSS-III BOSS Galaxies
• Time-Sliced Perturbation Theory for Large Scale Structure I: General Formalism
• Cosmology with Void-Galaxy Correlations
• Galaxy Power Spectrum Multipoles Covariance in Perturbation Theory
• Nearest Neighbor distributions: new statistical measures for cosmological clustering
• Information content of the non-linear matter power spectrum
• Modelling galaxy clustering: halo occupation distribution versus subhalo matching
• Emulating the CFHTLenS Weak Lensing data: Cosmological Constraints from moments and Minkowski functionals
• Redshift-space distortions around voids
• Constraints on the curvature of the Universe and dynamical dark energy from the Full-shape and BAO data
• Towards optimal extraction of cosmological information from nonlinear data
• Cosmological constraints from BOSS with analytic covariance matrices
• Full-shape cosmology analysis of SDSS-III BOSS galaxy power spectrum using emulator-based halo model: a $5\%$ determination of ${\sigma }_8$
• The Outer Rim Simulation: A Path to Many-Core Supercomputers
• A High-Fidelity Realization of the Euclid Code Comparison $N$-body Simulation with Abacus
• Sparse sampling, galaxy bias, and voids
• The Phase-Space Parameters of Brightest Halo Galaxies
• AbacusHOD: A highly efficient extended multi-tracer HOD framework and its application to BOSS and eBOSS data
• The VIMOS Public Extragalactic Redshift Survey: Measuring the growth rate of structure around cosmic voids
• Precision analysis of the redshift-space galaxy bispectrum
• \textsc{CompaSO}: A new halo finder for competitive assignment to spherical overdensities
• Detecting Neutrino Mass by Combining Matter Clustering, Halos, and Voids
• Comparing approximate methods for mock catalogues and covariance matrices II: Power spectrum multipoles
• Recursive Solutions of Lagrangian Perturbation Theory
• ShapeFit: extracting the power spectrum shape information in galaxy surveys beyond BAO and RSD
• Determining the Hubble Constant without the Sound Horizon: Measurements from Galaxy Surveys
• The Void Size Function in Dynamical Dark Energy Cosmologies
• Large-Scale Clustering of Cosmic Voids
• Precision cosmology with voids in the final BOSS data
• Dissecting and Modelling Galaxy Assembly Bias
• Simulations and symmetries
• Cosmology with the Galaxy Bispectrum Multipoles: Optimal Estimation and Application to BOSS Data
• Cosmic Shear Cosmology Beyond 2-Point Statistics: A Combined Peak Count and Correlation Function Analysis of DES-Y1
• Beyond LIMD bias: a measurement of the complete set of third-order halo bias parameters
• On the reach of perturbative descriptions for dark matter displacement fields
• CosmoBolognaLib: C++ libraries for cosmological calculations
• The BOSS bispectrum analysis at one loop from the Effective Field Theory of Large-Scale Structure
• The host dark matter halos of [OII] emitters at 0.5< z< 1.5
• Cosmic voids in modified gravity models with massive neutrinos
• The bias of cosmic voids in the presence of massive neutrinos
• A rigorous EFT-based forward model for large-scale structure
• The GIGANTES dataset: precision cosmology from voids in the machine learning era
• Voids in the SDSS DR9: observations, simulations, and the impact of the survey mask
• Multipole analysis of redshift-space distortions around cosmic voids
• On the linearity of tracer bias around voids
• Stringent ${\sigma }_8$ constraints from small-scale galaxy clustering using a hybrid MCMC+emulator framework
• Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections
• Euclid: Forecasts from redshift-space distortions and the Alcock-Paczynski test with cosmic voids
• Modeling Galaxies in Redshift Space at the Field Level
• Optimizing large-scale structure data analysis with the theoretical error likelihood
• Cosmological constraints without fingers of God
• A flexible modelling of galaxy assembly bias
• Cosmology Without Windows: Quadratic Estimators for the Galaxy Power Spectrum
• Redshift-space distortions with split densities
• Cosmology Without Window Functions: Cubic Estimators for the Galaxy Bispectrum
• Phantom-GRAPE: numerical software library to accelerate collisionless $N$-body simulation with SIMD instruction set on x86 architecture
• The Aemulus Project V: Cosmological constraint from small-scale clustering of BOSS galaxies
• Euclid: Cosmological forecasts from the void size function
• Cosmological exploitation of the size function of cosmic voids identified in the distribution of biased tracers
• A flexible subhalo abundance matching model for galaxy clustering in redshift space
• Accurate emulator for the redshift-space power spectrum of dark matter halos and its application to galaxy power spectrum
• The BACCO simulation project: biased tracers in real space
• Cosmological inference from Bayesian forward modelling of deep galaxy redshift surveys
• Performance Tuning of N-Body Codes on Modern Microprocessors: I. Direct Integration with a Hermite Scheme on x86_64 Architecture
• Clustering of Luminous Red Galaxies III: Detection of the Baryon Acoustic Peak in the 3-point Correlation Function
• Time-sliced perturbation theory with primordial non-Gaussianity and effects of large bulk flows on inflationary oscillating features
• An $n$-th order Lagrangian Forward Model for Large-Scale Structure
• Cosmological constraints from the BOSS DR12 void size function
• How much information can be extracted from galaxy clustering at the field level?
• Cluster-Void Degeneracy Breaking: Dark Energy, Planck and the Largest Cluster & Void
• Dark Energy Survey Year 1 results: The relationship between mass and light around cosmic voids
• Exploring the squeezed three-point galaxy correlation function with generalized halo occupation distribution models
• N-body simulation for self-gravitating collisional systems with a new SIMD instruction set extension to the x86 architecture, Advanced Vector eXtensions
• On the relative bias of void tracers in the Dark Energy Survey
• Real-space density profile reconstruction of stacked voids
• Redshift-space effects in voids and their impact on cosmological tests. Part I: the void size function
• Fortran interface layer of the framework for developing particle simulator FDPS
• Unbiased Cosmology Inference from Biased Tracers using the EFT Likelihood
• Cosmological Information in the Marked Power Spectrum of the Galaxy Field
• PPPM and TreePM Methods on GRAPE Systems for Cosmological N-body Simulations
• The effects of assembly bias on cosmological inference from galaxy-galaxy lensing and galaxy clusters
• Cosmology Inference from Biased Tracers using the EFT-based Likelihood
• ADDGALS: Simulated Sky Catalogs for Wide Field Galaxy Surveys
• The Bacco Simulation Project: Bacco Hybrid Lagrangian Bias Expansion Model in Redshift Space
• Aemulus $\nu$: Precise Predictions for Matter and Biased Tracer Power Spectra in the Presence of Neutrinos
• Cosmological constraints from the power spectrum of eBOSS quasars
• The EFT Likelihood for Large-Scale Structure
• Priors on Lagrangian bias parameters from galaxy formation modelling
• Constraints on $S_8$ from a full-scale and full-shape analysis of redshift-space clustering and galaxy-galaxy lensing in BOSS
• Consistency tests of field level inference with the EFT likelihood
• LtU-ILI: An All-in-One Framework for Implicit Inference in Astrophysics and Cosmology
• Redshift-space effects in voids and their impact on cosmological tests. Part II: the void-galaxy cross-correlation function
• Cosmological Constraints from Galaxy Clustering and the Mass-to-Number Ratio of Galaxy Clusters: Marginalizing over the Physics of Galaxy Formation
• Likelihood Non-Gaussianity in Large-Scale Structure Analyses
• Precise Cosmological Constraints from BOSS Galaxy Clustering with a Simulation-Based Emulator of the Wavelet Scattering Transform
• Cosmological exploitation of cosmic void statistics - New numerical tools in the CosmoBolognaLib to extract cosmological constraints from the void size function
• Galaxy Clustering Analysis with SimBIG and the Wavelet Scattering Transform
• Sigma-Eight at the Percent Level: The EFT Likelihood in Real Space
• Persistent homology in cosmic shear II: A tomographic analysis of DES-Y1
• $\mathrm{S}\mathrm{IM}\mathrm{BIG}$: Mock Challenge for a Forward Modeling Approach to Galaxy Clustering
• Impacts of the physical data model on the forward inference of initial conditions from biased tracers
• The one-loop bispectrum of galaxies in redshift space from the Effective Field Theory of Large-Scale Structure
• Cosmic voids uncovered -- first-order statistics of depressions in the biased density field
• The MillenniumTNG Project: Inferring cosmology from galaxy clustering with accelerated N-body scaling and subhalo abundance matching
• Cosmological Information in Skew Spectra of Biased Tracers in Redshift Space
• The perspective of voids on rising cosmology tensions
• Why Cosmic Voids Matter: Nonlinear Structure & Linear Dynamics
• DEMNUni: disentangling dark energy from massive neutrinos with the void size function
• Cosmology inference at the field level from biased tracers in redshift-space
• Exploring the cosmological synergy between galaxy cluster and cosmic void number counts
• Taming redshift-space distortion effects in the EFTofLSS and its application to data
• New constraints on cosmological modified gravity theories from anisotropic three-point correlation functions of BOSS DR12 galaxies
• The halo bias inside cosmic voids
• EFTofLSS meets simulation-based inference: ${\sigma }_8$ from biased tracers
• The Likelihood for LSS: Stochasticity of Bias Coefficients at All Orders
• Evidence of Galaxy Assembly Bias in SDSS DR7 Galaxy Samples from Count Statistics
• Bayesian Inference of Initial Conditions from Non-Linear Cosmic Structures using Field-Level Emulators
• Modelling galaxy clustering in redshift space with a Lagrangian bias formalism and $N$-body simulations
• The Aemulus Project VI: Emulation of beyond-standard galaxy clustering statistics to improve cosmological constraints
• Euclid preparation. XLI. Galaxy power spectrum modelling in real space
• HYMALAIA: A Hybrid Lagrangian Model for Intrinsic Alignments
• The EFT Likelihood for Large-Scale Structure in Redshift Space
• Cosmological constraints from weak lensing scattering transform using HSC Y1 data
• Super-sample covariance of the power spectrum, bispectrum, halos, voids, and their cross covariances
• Full forward model of galaxy clustering statistics with AbacusSummit lightcones
• The VIMOS VLT Deep Survey: Testing the gravitational instability paradigm at z ~ 1
• 2D k-th nearest neighbor statistics: a highly informative probe of galaxy clustering
• Neural Stellar Population Synthesis Emulator for the DESI PROVABGS
• Galaxy Clustering in the Mira-Titan Universe I: Emulators for the redshift space galaxy correlation function and galaxy-galaxy lensing
• Toward Accurate Modeling of Galaxy Clustering on Small Scales: Halo Model Extensions and Lingering Tension
• A field-level emulator for modified gravity
• Perturbation Theory Remixed: Improved Nonlinearity Modeling beyond Standard Perturbation Theory
• Dark Sage: Next-generation semi-analytic galaxy evolution with multidimensional structure and minimal free parameters
• Small scale clustering of BOSS galaxies: dependence on luminosity, color, age, stellar mass, specific star formation rate and other properties

Cited by in corpus (12)

• An Analytically Tractable Marked Power Spectrum
• Massive $\nu$s through the CNN lens: interpreting the field-level neutrino mass information in weak lensing
• Cosmology with voids from the Nancy Grace Roman Space Telescope
• Straightening the Ruler: Field-Level Inference of the BAO Scale with LEFTfield
• Field-level Reconstruction from Foreground-Contaminated 21-cm Maps
• Cosmological gravity on all scales IV: 3x2pt Fisher forecasts for pixelised phenomenological modified gravity
• A theoretical approach to density-split clustering
• Cosmological Analysis with Calibrated Neural Quantile Estimation and Approximate Simulators
• Benchmarking field-level cosmological inference from galaxy redshift surveys
• On the Connection between Field-Level Inference and $n$-point Correlation Functions
• Void spin distribution as a powerful probe of ${\sigma }_8$
• Cosmological gravity on all scales V: MCMC forecasts combining large scale structure and CMB lensing for binned phenomenological modified gravity