Dark Sky Simulations: Early Data Release

Abstract

The Dark Sky Simulations are an ongoing series of cosmological N-body simulations designed to provide a quantitative and accessible model of the evolution of the large-scale Universe. Such models are essential for many aspects of the study of dark matter and dark energy, since we lack a sufficiently accurate analytic model of non-linear gravitational clustering. In July 2014, we made available to the general community our early data release, consisting of over 55 Terabytes of simulation data products, including our largest simulation to date, which used $1.07\times 10^{12}(10240^3)$ particles in a volume $8h^{-1}\mathrm{Gpc}$ across. Our simulations were performed with 2HOT, a purely tree-based adaptive N-body method, running on 200,000 processors of the Titan supercomputer, with data analysis enabled by yt. We provide an overview of the derived halo catalogs, mass function, power spectra and light cone data. We show self-consistency in the mass function and mass power spectrum at the 1% level over a range of more than 1000 in particle mass. We also present a novel method to distribute and access very large datasets, based on an abstraction of the World Wide Web (WWW) as a file system, remote memory-mapped file access semantics, and a space-filling curve index. This method has been implemented for our data release, and provides a means to not only query stored results such as halo catalogs, but also to design and deploy new analysis techniques on large distributed datasets.

26 pages, 9 figures, project website at http://darksky.slac.stanford.edu, repository at http://bitbucket.org/darkskysims

References in corpus (38)

• HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
• Simulating the joint evolution of quasars, galaxies and their large-scale distribution
• Efficient Computation of CMB anisotropies in closed FRW models
• Where are the missing galactic satellites?
• The 6dF Galaxy Survey: Baryon Acoustic Oscillations and the Local Hubble Constant
• The Cosmic Linear Anisotropy Solving System (CLASS) II: Approximation schemes
• Stable clustering, the halo model and nonlinear cosmological power spectra
• Planck 2013 results. I. Overview of products and scientific results
• Mass function of dark matter halos
• BICEP2 I: Detection Of B-mode Polarization at Degree Angular Scales
• Observational Probes of Cosmic Acceleration
• Halo occupation numbers and galaxy bias
• Halos and galaxies in the standard cosmological model: results from the Bolshoi simulation
• Baryon Acoustic Oscillations in the Lyα forest of BOSS DR11 quasars
• Transients from Initial Conditions in Cosmological Simulations
• The Dependence of Halo Clustering on Halo Formation History, Concentration, and Occupation
• Evolution of structure in cold dark matter universes
• Haloes gone MAD: The Halo-Finder Comparison Project
• The Coyote Universe I: Precision Determination of the Nonlinear Matter Power Spectrum
• Cosmology with Weak Lensing Surveys
• Constraints on Cosmology from the Cosmic Microwave Background Power Spectrum of the 2500 ${\mathrm{deg}}^2$ SPT-SZ Survey
• Acoustic Signatures in the Cosmic Microwave Background
• Towards optimal softening in 3D N-body codes: I. Minimizing the force error
• RegPT: Direct and fast calculation of regularized cosmological power spectrum at two-loop order
• High Performance P3M N-body code: CUBEP3M
• SNSPH: A Parallel 3-D Smoothed Particle Radiation Hydrodynamics Code
• Fundamental Discreteness Limitations of Cosmological N-Body Clustering Simulations
• The WiggleZ Dark Energy Survey: constraining galaxy bias and cosmic growth with 3-point correlation functions
• The New Horizon Run Cosmological N-Body Simulations
• GOTPM: A Parallel Hybrid Particle-Mesh Treecode
• Halo and Galaxy Formation Histories from the Millennium Simulation: Public release of a VO-oriented and SQL-queryable database for studying the evolution of galaxies in the LambdaCDM cosmogony
• Toward an accurate mass function for precision cosmology
• 2HOT: An Improved Parallel Hashed Oct-Tree N-Body Algorithm for Cosmological Simulation
• Cosmic variance limited Baryon Acoustic Oscillations from the DEUS-FUR $\Lambda$CDM simulation
• The dark matter of galaxy voids
• Summary of the First Workshop on Sustainable Software for Science: Practice and Experiences (WSSSPE1)
• Cosmological Constraints from Galaxy Clustering and the Mass-to-Number Ratio of Galaxy Clusters: Marginalizing over the Physics of Galaxy Formation
• DEUS Full Observable ΛCDM Universe Simulation: the numerical challenge

Cited by in corpus (46)

• First results from the IllustrisTNG simulations: the stellar mass content of groups and clusters of galaxies
• The Effective Field Theorist's Approach to Gravitational Dynamics
• The clustering of galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: mock galaxy catalogues for the BOSS Final Data Release
• The Uchuu Simulations: Data Release 1 and Dark Matter Halo Concentrations
• AbacusSummit: A Massive Set of High-Accuracy, High-Resolution $N$-Body Simulations
• Beyond Assembly Bias: Exploring Secondary Halo Biases for Cluster-size Haloes
• Building disc structure and galaxy properties through angular momentum: The DARK SAGE semi-analytic model
• ICE-COLA: Towards fast and accurate synthetic galaxy catalogues optimizing a quasi $N$-body method
• Precision Comparison of the Power Spectrum in the EFTofLSS with Simulations
• A statistical investigation of the mass discrepancy-acceleration relation
• Concentrations of Dark Haloes Emerge from Their Merger Histories
• Active Galactic Nuclei and their Large-scale Structure: an eROSITA mock catalogue
• Galaxy formation with L-GALAXIES: Modelling the environmental dependency of galaxy evolution and comparing with observations
• The scatter, residual correlations and curvature of the SPARC baryonic Tully-Fisher relation
• Machine Learning and Cosmological Simulations II: Hydrodynamical Simulations
• An Introductory Review on Cosmic Reionization
• Matter Power Spectrum Covariance Matrix from the DEUS-PUR ΛCDM simulations: Mass Resolution and non-Gaussian Errors
• Accurate mass and velocity functions of dark matter halos
• CARPool: fast, accurate computation of large-scale structure statistics by pairing costly and cheap cosmological simulations
• Machine Learning and Cosmological Simulations I: Semi-Analytical Models
• Mapping Extragalactic Dark Matter Annihilation with Galaxy Surveys: A Systematic Study of Stacked Group Searches
• The Faber-Jackson relation and Fundamental Plane from halo abundance matching
• Exploring the evidence for a large local void with supernovae Ia data
• Reconstructing the gravitational field of the local universe
• Machine-assisted Semi-Simulation Model (MSSM): Estimating Galactic Baryonic Properties from their Dark Matter using a Machine Trained on Hydrodynamic Simulations
• Velocity-Density Correlations from the cosmicflows-3 Distance Catalog and the 2MASS Redshift Survey
• The dipole anisotropy of AllWISE galaxies
• ICE-COLA: fast simulations for weak lensing observables
• Hunting down systematics in baryon acoustic oscillations after cosmic high noon
• Void-and-Cluster Sampling of Large Scattered Data and Trajectories
• Importance of Mock Observations in Validating Galaxy Properties for Cosmological Simulations
• The dependence of subhalo abundance matching on galaxy photometry and selection criteria
• Frames of most uniform Hubble flow
• The IllustrisTNG Simulations: Public Data Release
• Probing large scale homogeneity and periodicity in the LRG distribution using Shannon entropy
• Uncorrelated velocity and size residuals across galaxy rotation curves
• Matrix Formalism of Excursion Set Theory: A new approach to statistics of dark matter halo counting
• Testing self-interacting dark matter with galaxy warps
• A Machine Learning Approach to Galaxy-LSS Classification I: Imprints on Halo Merger Trees
• The clustering of LRGs in the DECaLS DR8 footprint: distance constraints from baryon acoustic oscillations using photometric redshifts
• Quantifying the Projected Suppression of Cluster Escape Velocity Profiles
• Massively Parallel Computation of Accurate Densities for N-body Dark Matter Simulations using the Phase-Space-Element Method
• Characterising cosmic inhomogeneity with anomalous diffusion
• Visualizing Time-Varying Particle Flows with Diffusion Geometry
• A Hydro-Particle-Mesh Code for Efficient and Rapid Simulations of the Intracluster Medium
• Extragalactic Searches for Dark Matter Annihilation