Scalable Streaming Tools for Analyzing -body Simulations: Finding Halos and Investigating Excursion Sets in One Pass
arXiv:1711.00975 · doi:10.1016/j.ascom.2018.04.003
Abstract
Cosmological -body simulations play a vital role in studying models for the evolution of the Universe. To compare to observations and make a scientific inference, statistic analysis on large simulation datasets, e.g., finding halos, obtaining multi-point correlation functions, is crucial. However, traditional in-memory methods for these tasks do not scale to the datasets that are forbiddingly large in modern simulations. Our prior paper proposes memory-efficient streaming algorithms that can find the largest halos in a simulation with up to particles on a small server or desktop. However, this approach fails when directly scaling to larger datasets. This paper presents a robust streaming tool that leverages state-of-the-art techniques on GPU boosting, sampling, and parallel I/O, to significantly improve performance and scalability. Our rigorous analysis of the sketch parameters improves the previous results from finding the centers of the largest halos to , and reveals the trade-offs between memory, running time and number of halos. Our experiments show that our tool can scale to datasets with up to particles while using less than an hour of running time on a single GPU Nvidia GTX 1080.
arXiv commentpreprint
References in corpus (11)
- The cosmological simulation code GADGET-2
- Ahf: Amiga's Halo Finder
- Scaling relations for galaxy clusters in the Millennium-XXL simulation
- The evolution substructure I: a new identification method
- Haloes gone MAD: The Halo-Finder Comparison Project
- Structure Finding in Cosmological Simulations: The State of Affairs
- ORIGAMI: Delineating Halos using Phase-Space Folds
- The halo model and numerical simulations
- VOBOZ: An Almost-Parameter-Free Halo-Finding Algorithm
- ASOHF: a new adaptive spherical overdensity halo finder
- Examining subgrid models of supermassive black holes in cosmological simulation