Constraining Galaxy-Halo Connection Using Machine Learning

Abstract

We investigate the potential of machine learning (ML) methods to model small-scale galaxy clustering for constraining Halo Occupation Distribution (HOD) parameters. Our analysis reveals that while many ML algorithms report good statistical fits, they often yield likelihood contours that are significantly biased in both mean values and variances relative to the true model parameters. This highlights the importance of careful data processing and algorithm selection in ML applications for galaxy clustering, as even seemingly robust methods can lead to biased results if not applied correctly. ML tools offer a promising approach to exploring the HOD parameter space with significantly reduced computational costs compared to traditional brute-force methods if their robustness is established. Using our ANN-based pipeline, we successfully recreate some standard results from recent literature. Properly restricting the HOD parameter space, transforming the training data, and carefully selecting ML algorithms are essential for achieving unbiased and robust predictions. Among the methods tested, artificial neural networks (ANNs) outperform random forests (RF) and ridge regression in predicting clustering statistics, when the HOD prior space is appropriately restricted. We demonstrate these findings using the projected two-point correlation function ($w_{\mathrm{p}}(r_{\mathrm{p}})$), angular multipoles of the correlation function (${\xi }_{\ell }(r)$), and the void probability function (VPF) of Luminous Red Galaxies from Dark Energy Spectroscopic Instrument mocks. Our results show that while combining $w_{\mathrm{p}}(r_{\mathrm{p}})$ and VPF improves parameter constraints, adding the multipoles ${\xi }_0$, ${\xi }_2$, and ${\xi }_4$ to $w_{\mathrm{p}}(r_{\mathrm{p}})$ does not significantly improve the constraints.

19 pages, 14 figures, final revisions suggested by Astronomy & Computing

References in corpus (60)

• Scikit-learn: Machine Learning in Python
• Deep Learning in Neural Networks: An Overview
• emcee: The MCMC Hammer
• The cosmological simulation code GADGET-2
• The EAGLE project: Simulating the evolution and assembly of galaxies and their environments
• E pur si muove: Galiliean-invariant cosmological hydrodynamical simulations on a moving mesh
• Cosmological Hydrodynamics with Adaptive Mesh Refinement: a new high resolution code called RAMSES
• The Baryon Oscillation Spectroscopic Survey of SDSS-III
• Halo Models of Large Scale Structure
• GADGET: A code for collisionless and gasdynamical cosmological simulations
• The DESI Experiment Part I: Science,Targeting, and Survey Design
• Analytic model for galaxy and dark matter clustering
• Simba: Cosmological Simulations with Black Hole Growth and Feedback
• Wide-Field InfrarRed Survey Telescope-Astrophysics Focused Telescope Assets WFIRST-AFTA 2015 Report
• Halo occupation numbers and galaxy bias
• MultiDark simulations: the story of dark matter halo concentrations and density profiles
• The Halo Occupation Distribution: Towards an Empirical Determination of the Relation Between Galaxies and Mass
• Theoretical Models of the Halo Occupation Distribution: Separating Central and Satellite Galaxies
• Dancing in the dark: galactic properties trace spin swings along the cosmic web
• How Many Galaxies Fit in a Halo? Constraints on Galaxy Formation Efficiency from Spatial Clustering
• Galaxy Evolution from Halo Occupation Distribution Modeling of DEEP2 and SDSS Galaxy Clustering
• The Illustris Simulation: Public Data Release
• The BAHAMAS project: Calibrated hydrodynamical simulations for large-scale structure cosmology
• The Horizon-AGN simulation: morphological diversity of galaxies promoted by AGN feedback
• Scaling relations for galaxy clusters in the Millennium-XXL simulation
• Spatial correlation function and pairwise velocity dispersion of galaxies: CDM models versus the Las Campanas Survey
• Simulating cosmic structure formation with the GADGET-4 code
• Statistical Analysis of Galaxy Surveys - I. Robust error estimation for 2-point clustering statistics
• AbacusSummit: A Massive Set of High-Accuracy, High-Resolution $N$-Body Simulations
• Median Statistics, H_0, and the Accelerating Universe
• Halo Occupation Distribution Modeling of Clustering of Luminous Red Galaxies
• Corrfunc --- A Suite of Blazing Fast Correlation Functions on the CPU
• The MICE Grand Challenge Lightcone Simulation III: Galaxy lensing mocks from all-sky lensing maps
• The Aemulus Project I: Numerical Simulations for Precision Cosmology
• The Impact of Assembly Bias on the Galaxy Content of Dark Matter Halos
• Forward Modeling of Large-Scale Structure: An open-source approach with Halotools
• The $\text{Abacus}$ Cosmological $N$-body Code
• GreeM : Massively Parallel TreePM Code for Large Cosmological N-body Simulations
• The impact of assembly bias on the halo occupation in hydrodynamical simulations
• The Abacus Cosmos: A Suite of Cosmological N-body Simulations
• The Outer Rim Simulation: A Path to Many-Core Supercomputers
• A High-Fidelity Realization of the Euclid Code Comparison $N$-body Simulation with Abacus
• Revealing the galaxy-halo connection in IllustrisTNG
• Multi-tracer extension of the halo model: probing quenching and conformity in eBOSS
• Improving Initial Conditions for Cosmological $N$-Body Simulations
• Painting galaxies into dark matter halos using machine learning
• Performance of internal Covariance Estimators for Cosmic Shear Correlation Functions
• Machine learning cosmological structure formation
• Modeling the Impact of Baryons on Subhalo Populations with Machine Learning
• CONNECT: A neural network based framework for emulating cosmological observables and cosmological parameter inference
• A machine learning approach to galaxy properties: joint redshift-stellar mass probability distributions with Random Forest
• A Hybrid Deep Learning Approach to Cosmological Constraints From Galaxy Redshift Surveys
• Creating Jackknife and Bootstrap estimates of the covariance matrix for the two-point correlation function
• A First Look at creating mock catalogs with machine learning techniques
• How galaxies populate haloes in very low-density environments? An analysis of the Halo Occupation Distribution in cosmic voids
• Multiwavelength cluster mass estimates and machine learning
• Does jackknife scale really matter for accurate large-scale structure covariances?
• How do galaxies populate halos in extreme density environments? An analysis of the Halo Occupation Distribution in SDSS
• Modeling assembly bias with machine learning and symbolic regression
• Galaxy populations in haloes in high-density environments

Cited by in corpus (1)

• A Non-parametric Method for the Inference of Halo Occupation Distributions