Corrfunc --- A Suite of Blazing Fast Correlation Functions on the CPU

Abstract

The two-point correlation function (2PCF) is the most widely used tool for quantifying the spatial distribution of galaxies. Since the distribution of galaxies is determined by galaxy formation physics as well as the underlying cosmology, fitting an observed correlation function yields valuable insights into both. The calculation for a 2PCF involves computing pair-wise separations and consequently, the computing time scales quadratically with the number of galaxies. The next-generation galaxy surveys are slated to observe many millions of galaxies, and computing the 2PCF for such surveys would be prohibitively time-consuming. Additionally, modern modelling techniques require the 2PCF to be calculated thousands of times on simulated galaxy catalogues of {\em at least} equal size to the data and would be completely unfeasible for the next generation surveys. Thus, calculating the 2PCF forms a substantial bottleneck in improving our understanding of the fundamental physics of the universe, and we need high-performance software to compute the correlation function. In this paper, we present Corrfunc --- a suite of highly optimised, OpenMP parallel clustering codes. The improved performance of Corrfunc arises from both efficient algorithms as well as software design that suits the underlying hardware of modern CPUs. Corrfunc can compute a wide range of 2-D and 3-D correlation functions in either simulation (Cartesian) space or on-sky coordinates. Corrfunc runs efficiently in both single- and multi-threaded modes and can compute a typical 2-point projected correlation function ($w_p(r_p)$) for ~1 million galaxies within a few seconds on a single thread. Corrfunc is designed to be both user-friendly and fast and is publicly available at https://github.com/manodeep/Corrfunc.

Accepted for publication to MNRAS

References in corpus (5)

• The NumPy array: a structure for efficient numerical computation
• Cosmological Constraints from the SDSS Luminous Red Galaxies
• Studying Reionization with Ly-alpha Emitters
• Spatial Clustering of Dark Matter Halos: Secondary Bias, Neighbor Bias, and the Influence of Massive Neighbors on Halo Properties
• Pairwise velocities in the "Running FLRW" cosmological model

Cited by in corpus (20)

• AbacusSummit: A Massive Set of High-Accuracy, High-Resolution $N$-Body Simulations
• Large-scale dark matter simulations
• The $\text{Abacus}$ Cosmological $N$-body Code
• Semi-analytic forecasts for JWST -- VI. Simulated lightcones and galaxy clustering predictions
• The galaxy-halo connection of emission-line galaxies in IllustrisTNG
• The physical drivers of the atomic hydrogen-halo mass relation
• A First Detection of the Connected 4-Point Correlation Function of Galaxies Using the BOSS CMASS Sample
• Host Dark Matter Halos of WISE-selected Obscured & Unobscured Quasars: Evidence for Evolution
• DESI Legacy Imaging Surveys Data Release 9: Cosmological Constraints from Galaxy Clustering and Weak Lensing using the Minimal Bias Model
• Host Dark Matter Halos of SDSS Red and Blue Quasars: No Significant Difference in Large-scale Environment
• 2D k-th nearest neighbor statistics: a highly informative probe of galaxy clustering
• Halo Occupation Distribution of Emission Line Galaxies: fitting method with Gaussian Processes
• Fast Correlation Function Calculator -- A high-performance pair counting toolkit
• Galaxy and Mass Assembly (GAMA): the clustering of galaxy groups
• HI HOD -- I. The Halo Occupation Distribution of HI Galaxies
• Two-point statistics without bins: A continuous-function generalization of the correlation function estimator for large-scale structure
• Unraveling emission line galaxy conformity at z~1 with DESI early data
• The role of scatter and satellites in shaping the large-scale clustering of X-ray AGN as a function of host galaxy stellar mass
• Galaxy assembly bias and large-scale distribution: a comparison between IllustrisTNG and a semi-analytic model
• Galaxy Correlation Function and Local Density from Photometric Redshifts Using the Stochastic Order Redshift Technique (SORT)