Dark from light (DfL): Inferring halo properties from luminous tracers with machine learning trained on cosmological simulations. I. Method, proof of concept & preliminary testing
arXiv:2507.00351 · doi:10.1051/0004-6361/202554702
Abstract
We present Dark from Light (DfL) - a novel method to infer the dark sector in wide-field galaxy surveys, leveraging a machine learning approach trained on contemporary cosmological simulations. The aim of this algorithm is to provide a fast, straightforward, and accurate route to estimating dark matter halo masses and group membership in wide-field spectroscopic galaxy surveys. This approach requires a highly limited number of input parameters and yields full probability distribution functions for the output halo masses. To achieve this, we train a series of Random Forest (RF) regression models on the IllustrisTNG and EAGLE simulations at z=0-3, which provide model-dependent mappings from luminous tracers to dark matter halo properties. We incorporate the individual regression models into a virial group-finding algorithm (DfL), which outputs halo properties for observational-like input data. We test the method at z=0-2 for both the EAGLE and IllustrisTNG models, as well as in a cross-validation mode. We demonstrate that known halo masses can be recovered with a mean systematic bias of dex (resulting from simulation choice), a mean statistical uncertainty of dex across epochs, and a central - (core) satellite classification accuracy of 96%. We establish that this approach yields superior halo mass recovery to standard abundance matching applied to groups identified through a friends-of-friends algorithm. Additionally, we compare the outputs of DfL to observational constraints on the relation from strong gravitational lensing at , demonstrating the promise of this novel approach. Finally, we systematically quantify how DfL performs on observational-like input data with varying stellar mass uncertainty and spectroscopic incompleteness, enabling robust error calibration.
arXiv commentAccepted to A&A. 37 pages, 18 figures
References in corpus (132)
- Observation of Gravitational Waves from a Binary Black Hole Merger
- First Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Determination of Cosmological Parameters
- Planck 2015 results. XIII. Cosmological parameters
- GW170817: Observation of Gravitational Waves from a Binary Neutron Star Inspiral
- Galactic Stellar and Substellar Initial Mass Function
- Seven-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Cosmological Interpretation
- The Structure of Cold Dark Matter Halos
- Wilkinson Microwave Anisotropy Probe (WMAP) Three Year Results: Implications for Cosmology
- Star Formation in Galaxies Along the Hubble Sequence
- Planck 2013 results. XVI. Cosmological parameters
- Dynamics of dark energy
- Simulating the joint evolution of quasars, galaxies and their large-scale distribution
- The Host Galaxies of AGN
- The EAGLE project: Simulating the evolution and assembly of galaxies and their environments
- The physical properties of star forming galaxies in the low redshift universe
- Populating a cluster of galaxies - I. Results at z=0
- Theoretical Modeling of Starburst Galaxies
- The broken hierarchy of galaxy formation
- E pur si muove: Galiliean-invariant cosmological hydrodynamical simulations on a moving mesh
- Introducing the Illustris Project: Simulating the coevolution of dark and visible matter in the Universe
- The Host Galaxies and Classification of Active Galactic Nuclei
- CANDELS: The Cosmic Assembly Near-infrared Deep Extragalactic Legacy Survey
- CANDELS: The Cosmic Assembly Near-infrared Deep Extragalactic Legacy Survey - The Hubble Space Telescope Observations, Imaging Data Products and Mosaics
- Mass and environment as drivers of galaxy evolution in SDSS and zCOSMOS and the origin of the Schechter function
- Simulating Galaxy Formation with the IllustrisTNG Model
- Hierarchical Galaxy Formation
- First results from the IllustrisTNG simulations: matter and galaxy clustering
- Accurate photometric redshifts for the CFHT Legacy Survey calibrated using the VIMOS VLT Deep Survey
- First results from the IllustrisTNG simulations: the galaxy color bimodality
- Cosmological Tracking Solutions
- The EAGLE simulations of galaxy formation: calibration of subgrid physics and model variations
- Physical Models of Galaxy Formation in a Cosmological Framework
- Properties of galaxies reproduced by a hydrodynamic simulation
- First results from the IllustrisTNG simulations: A tale of two elements -- chemical evolution of magnesium and europium
- Simulating galaxy formation with black hole driven thermal and kinetic feedback
- Constraints on the relationship between stellar mass and halo mass at low and high redshift
- The SAURON project - IV. The mass-to-light ratio, the virial mass estimator and the fundamental plane of elliptical and lenticular galaxies
- Simba: Cosmological Simulations with Black Hole Growth and Feedback
- Substructures in hydrodynamical cluster simulations
- Halo occupation numbers and galaxy bias
- A Comprehensive Analysis of Uncertainties Affecting the Stellar Mass - Halo Mass Relation for 0<z<4
- Gravity Probe B: Final Results of a Space Experiment to Test General Relativity
- Galaxy Groups in the SDSS DR4: I. The Catalogue and Basic Properties
- Cosmology with the Sunyaev-Zel'dovich Effect
- Halos and galaxies in the standard cosmological model: results from the Bolshoi simulation
- High-Resolution Rotation Curves and Galaxy Mass Models from THINGS
- The Dark Side of the Halo Occupation Distribution
- The Halo Occupation Distribution: Towards an Empirical Determination of the Relation Between Galaxies and Mass
- Dancing in the dark: galactic properties trace spin swings along the cosmic web
- Modeling Luminosity-Dependent Galaxy Clustering Through Cosmic Time
- Rotation-invariant convolutional neural networks for galaxy morphology prediction
- The Milky Way's Circular Velocity Curve to 60 kpc and an Estimate of the Dark Matter Halo Mass from Kinematics of ~2400 SDSS Blue Horizontal Branch Stars
- Galaxy halo masses and satellite fractions from galaxy-galaxy lensing in the SDSS: stellar mass, luminosity, morphology, and environment dependencies
- The Atlas3D project - XX. Mass-size and mass-sigma distributions of early-type galaxies: bulge fraction drives kinematics, mass-to-light ratio, molecular gas fraction and stellar initial mass function
- Galaxy formation in the Planck Cosmology - I. Matching the observed evolution of star formation rates, colours and stellar masses
- Mass Estimates of X-Ray Clusters
- Linking halo mass to galaxy luminosity
- Strong Nebular Line Ratios in the Spectra of z~2-3 Star-forming Galaxies: First Results from KBSS-MOSFIRE
- Galaxy Evolution from Halo Occupation Distribution Modeling of DEEP2 and SDSS Galaxy Clustering
- Precision Determination of the Mass Function of Dark Matter Halos
- The Sloan Lens ACS Survey. I. A Large Spectroscopically Selected Sample of Massive Early-Type Lens Galaxies
- The Stellar, Gas and Dynamical Masses of Star-Forming Galaxies at z~2
- The Nature of Galaxy Bias and Clustering
- The EAGLE simulations of galaxy formation: public release of halo and galaxy catalogues
- Supermassive black holes and their feedback effects in the IllustrisTNG simulation
- Anisotropies in the Cosmic Microwave Background: An Analytic Approach
- Galaxy Cluster Virial Masses and Omega
- The MOSFIRE Deep Evolution Field (MOSDEF) Survey: Rest-Frame Optical Spectroscopy for ~1500 H-Selected Galaxies at 1.37 < z < 3.8
- Mass and Environment as Drivers of Galaxy Evolution II: The quenching of satellite galaxies as the origin of environmental effects
- Haloes gone MAD: The Halo-Finder Comparison Project
- Weak lensing for precision cosmology
- Cluster Cosmology Constraints from the 2500 deg SPT-SZ Survey: Inclusion of Weak Gravitational Lensing Data from Magellan and the Hubble Space Telescope
- JADES. The diverse population of infant Black Holes at 4<z<11: merging, tiny, poor, but mighty
- Ancient Light from Young Cosmic Cities: Physical and Observational Signatures of Galaxy Proto-Clusters
- Gas entropy in a representative sample of nearby X-ray galaxy clusters (REXCESS): relationship to gas mass fraction
- The MassiveBlack-II Simulation: The Evolution of Halos and Galaxies to z~0
- Halo assembly bias and its effects on galaxy clustering
- The Romulus Cosmological Simulations: A Physical Approach to the Formation, Dynamics and Accretion Models of SMBHs
- On the cosmic ray bound for models of extragalactic neutrino production
- Galaxy Groups in the SDSS DR4: III. the luminosity and stellar mass functions
- Stellar and total baryon mass fractions in groups and clusters since redshift 1
- The realm of the galaxy protoclusters
- Galaxies in LCDM with Halo Abundance Matching: luminosity-velocity relation, baryonic mass-velocity relation, velocity function and clustering
- The splashback radius as a physical halo boundary and the growth of halo mass
- Bulge mass is king: The dominant role of the bulge in determining the fraction of passive galaxies in the Sloan Digital Sky Survey
- A catalog of bulge, disk, and total stellar mass estimates for the Sloan Digital Sky Survey
- The Extreme Faint End of the UV Luminosity Function at Through Gravitational Telescopes: a comprehensive assessment of strong lensing uncertainties
- The blazar TXS 0506+056 associated with a high-energy neutrino: insights into extragalactic jets and cosmic ray acceleration
- Spatially-Resolved Spectroscopic Properties of Low-Redshift Star-Forming Galaxies
- Dependence of Galaxy Quenching on Halo Mass and Distance from its Centre
- Dark Matter Contraction and the Stellar Content of Massive Early-type Galaxies: Disfavoring "Light" Initial Mass Functions
- Splashback in accreting dark matter halos
- Inference of the Cold Dark Matter substructure mass function at z=0.2 using strong gravitational lenses
- Galaxy Zoo: Reproducing Galaxy Morphologies Via Machine Learning
- Ejective and preventative: the IllustrisTNG black hole feedback and its effects on the thermodynamics of the gas within and around galaxies
- Strong bimodality in the host halo mass of central galaxies from galaxy-galaxy lensing
- Masses of galaxy clusters from gravitational lensing
- Detection of the Splashback Radius and Halo Assembly bias of Massive Galaxy Clusters
- Subhalo abundance matching and assembly bias in the EAGLE simulation
- The overdensity and masses of the friends-of-friends halos and universality of the halo mass function
- How do central and satellite galaxies quench? -- Insights from spatially resolved spectroscopy in the MaNGA survey
- The DEEP2 Galaxy Redshift Survey: First results on galaxy groups
- Learning Bayesian posteriors with neural networks for gravitational-wave inference
- Are galactic star formation and quenching governed by local, global or environmental phenomena?
- The Concentration Dependence of the Galaxy-Halo Connection: Modeling Assembly Bias with Abundance Matching
- An optical group catalogue to z = 1 from the zCOSMOS 10k sample
- The impact of galactic properties and environment on the quenching of central and satellite galaxies: A comparison between SDSS, Illustris and L-Galaxies
- Using Machine Learning for Discovery in Synoptic Survey Imaging
- The impact of assembly bias on the halo occupation in hydrodynamical simulations
- Limitations to the "basic'' HOD model and beyond
- The Halo Boundary of Galaxy Clusters in the SDSS
- The Dark Side of Galaxy Color: evidence from new SDSS measurements of galaxy clustering and lensing
- SHAM Beyond Clustering: New Tests of Galaxy-Halo Abundance Matching with Galaxy Groups
- \textsc{CompaSO}: A new halo finder for competitive assignment to spherical overdensities
- A catalog of polychromatic bulge-disk decompositions of ~ 17.600 galaxies in CANDELS
- The quenching of galaxies, bulges, and disks since cosmic noon: A machine learning approach for identifying causality in astronomical data
- Friends-of-friends galaxy group finder with membership refinement. Application to the local Universe
- An Artificial Neural Network Approach For Ranking Quenching Parameters In Central Galaxies
- The Galaxy Clustering Crisis in Abundance Matching
- How well does the Friends-of-Friends algorithm recover group properties from galaxy catalogs limited in both distance and luminosity?
- The fundamental signature of star formation quenching from AGN feedback: A critical dependence of quiescence on supermassive black hole mass not accretion rate
- Extensions to models of the galaxy-halo connection
- Galaxy Formation as a Cosmological Tool. I: The Galaxy Merger History as a Measure of Cosmological Parameters
- A machine learning approach to galaxy properties: joint redshift-stellar mass probability distributions with Random Forest
- The origin of the mass scales for maximal star formation efficiency and quenching: the critical role of Supernovae
- The MillenniumTNG Project: An improved two-halo model for the galaxy-halo connection of red and blue galaxies
- The dependence of galaxy clustering on stellar mass, star-formation rate and redshift at z = 0.8-2.2, with HiZELS
- Probabilistic Mass Mapping with Neural Score Estimation
- LtU-ILI: An All-in-One Framework for Implicit Inference in Astrophysics and Cosmology
- The MillenniumTNG Project: Refining the one-halo model of red and blue galaxies at different redshifts
- Constraining cosmological parameters from N-body simulations with Variational Bayesian Neural Networks
- Optimizing high redshift galaxy surveys for environmental information