The emptiness inside: Finding gaps, valleys, and lacunae with geometric data analysis

Abstract

Discoveries of gaps in data have been important in astrophysics. For example, there are kinematic gaps opened by resonances in dynamical systems, or exoplanets of a certain radius that are empirically rare. A gap in a data set is a kind of anomaly, but in an unusual sense: Instead of being a single outlier data point, situated far from other data points, it is a region of the space, or a set of points, that is anomalous compared to its surroundings. Gaps are both interesting and hard to find and characterize, especially when they have non-trivial shapes. We present in this paper a statistic that can be used to estimate the (local) "gappiness" of a point in the data space. It uses the gradient and Hessian of the density estimate (and thus requires a twice-differentiable density estimator). This statistic can be computed at (almost) any point in the space and does not rely on optimization; it allows to highlight under-dense regions of any dimensionality and shape in a general and efficient way. We illustrate our method on the velocity distribution of nearby stars in the Milky Way disk plane, which exhibits gaps that could originate from different processes. Identifying and characterizing those gaps could help determine their origins. We provide in an Appendix implementation notes and additional considerations for finding under-densities in data, using critical points and the properties of the Hessian of the density.

17 pages, 10 figures. Submitted to AJ. Comments welcomed. Revision: added 3D gridding + restructured outline: implementation notes (Quadratic Kernel) and methods for approx critical points and 1d-valley now in Annex

References in corpus (12)

• Array Programming with NumPy
• The Gaia mission
• galpy: A Python Library for Galactic Dynamics
• Measuring the rotation period distribution of field M-dwarfs with Kepler
• ZOBOV: a parameter-free void-finding algorithm
• The Gaia-Kepler Stellar Properties Catalog. II. Planet Radius Demographics as a Function of Stellar Mass and Age
• Distances and parallax bias in Gaia DR2
• The weirdest SDSS galaxies: results from an outlier detection algorithm
• Simulating nonlinear cosmological structure formation with massive neutrinos
• On the ridges, undulations & streams in Gaia DR2: Linking the topography of phase-space to the orbital structure of an N-body bar
• The GIGANTES dataset: precision cosmology from voids in the machine learning era
• Gaia Gaps and the Physics of Low-Mass Stars. I. The Fully Convective Boundary

Cited by in corpus (3)

• Prospects for Detecting Gaps in Globular Cluster Stellar Streams in External Galaxies with the Nancy Grace Roman Space Telescope
• Radial and azimuthal gradients of the moving groups in Gaia DR3: The slow/fast bar degeneracy problem
• Confined tumbling state as the origin of the excess of slowly rotating asteroids