The emptiness inside: Finding gaps, valleys, and lacunae with geometric data analysis

Abstract

Discoveries of gaps in data have been important in astrophysics. For example, there are kinematic gaps opened by resonances in dynamical systems, or exoplanets of a certain radius that are empirically rare. A gap in a data set is a kind of anomaly, but in an unusual sense: Instead of being a single outlier data point, situated far from other data points, it is a region of the space, or a set of points, that is anomalous compared to its surroundings. Gaps are both interesting and hard to find and characterize, especially when they have non-trivial shapes. We present in this paper a statistic that can be used to estimate the (local) "gappiness" of a point in the data space. It uses the gradient and Hessian of the density estimate (and thus requires a twice-differentiable density estimator). This statistic can be computed at (almost) any point in the space and does not rely on optimization; it allows to highlight under-dense regions of any dimensionality and shape in a general and efficient way. We illustrate our method on the velocity distribution of nearby stars in the Milky Way disk plane, which exhibits gaps that could originate from different processes. Identifying and characterizing those gaps could help determine their origins. We provide in an Appendix implementation notes and additional considerations for finding under-densities in data, using critical points and the properties of the Hessian of the density.

arXiv comment17 pages, 10 figures. Submitted to AJ. Comments welcomed. Revision: added 3D gridding + restructured outline: implementation notes (Quadratic Kernel) and methods for approx critical points and 1d-valley now in Annex

References in corpus (43)

• Array Programming with NumPy
• Gaia Data Release 2. Summary of the contents and survey properties
• The Astropy Project: Building an inclusive, open-science project and status of the v2.0 core package
• The Gaia mission
• Color Separation of Galaxy Types in the Sloan Digital Sky Survey Imaging Data
• Quantifying the bimodal color-magnitude distribution of galaxies
• galpy: A Python Library for Galactic Dynamics
• The California-Kepler Survey. III. A Gap in the Radius Distribution of Small Planets
• Galaxy bimodality versus stellar mass and environment
• A geometric distance measurement to the Galactic Center black hole with 0.3% uncertainty
• The Green Valley is a Red Herring: Galaxy Zoo reveals two evolutionary pathways towards quenching of star formation in early- and late-type galaxies
• A dynamically young and perturbed Milky Way disk
• Measuring the rotation period distribution of field M-dwarfs with Kepler
• Vertical waves in the solar neighbourhood in Gaia DR2
• ZOBOV: a parameter-free void-finding algorithm
• Galaxy Zoo : 'Hanny's Voorwerp', a quasar light echo?
• Footprints of the Sagittarius dwarf galaxy in the $Gaia$ data set
• Planet Hunters X. KIC 8462852 - Where's the Flux?
• Green Pea Galaxies and cohorts: Luminous Compact Emission-Line Galaxies in the Sloan Digital Sky Survey
• Signatures of the Core-Powered Mass-Loss Mechanism in the Exoplanet Population: Dependence on Stellar Properties and Observational Predictions
• Constraints on Cosmology and Gravity from the Dynamics of Voids
• The Gaia-Kepler Stellar Properties Catalog. II. Planet Radius Demographics as a Function of Stellar Mass and Age
• Distances and parallax bias in Gaia DR2
• Precision cosmology with voids: definition, methods, dynamics
• The Proper Motion of Sagittarius A*: III. The Case for a Supermassive Black Hole
• The weirdest SDSS galaxies: results from an outlier detection algorithm
• Radial Distribution of Stellar Motions in Gaia DR2
• The echo of the bar buckling: phase-space spirals in Gaia DR2
• Simulating nonlinear cosmological structure formation with massive neutrinos
• Transient spiral structure and the disc velocity substructure in Gaia DR2
• The GALAH survey and Gaia DR2: Linking ridges, arches and vertical waves in the kinematics of the Milky Way
• On the ridges, undulations & streams in Gaia DR2: Linking the topography of phase-space to the orbital structure of an N-body bar
• A Gap in the Lower Main Sequence Revealed by Gaia Data Release 2
• The GIGANTES dataset: precision cosmology from voids in the machine learning era
• Nonparametric ridge estimation
• Finding cosmic voids and filament loops using topological data analysis
• Detecting outliers in astronomical images with deep generative networks
• Evolution of the Exoplanet Size Distribution: Forming Large Super-Earths Over Billions of Years
• A Population Background for Nonparametric Density-Based Clustering
• Stellar Rotation in the K2 Sample: Evidence for Modified Spindown
• Anomaly detection in Hyper Suprime-Cam galaxy images with generative adversarial networks
• Gaia Gaps and the Physics of Low-Mass Stars. I. The Fully Convective Boundary
• A method for finding anomalous astronomical light curves and their analogs

Cited by in corpus (3)

• Prospects for Detecting Gaps in Globular Cluster Stellar Streams in External Galaxies with the Nancy Grace Roman Space Telescope
• Radial and azimuthal gradients of the moving groups in Gaia DR3: The slow/fast bar degeneracy problem
• Confined tumbling state as the origin of the excess of slowly rotating asteroids