Exploiting Low-Dimensional Structure in Astronomical Spectra

Abstract

Dimension-reduction techniques can greatly improve statistical inference in astronomy. A standard approach is to use Principal Components Analysis (PCA). In this work we apply a recently-developed technique, diffusion maps, to astronomical spectra for data parameterization and dimensionality reduction, and develop a robust, eigenmode-based framework for regression. We show how our framework provides a computationally efficient means by which to predict redshifts of galaxies, and thus could inform more expensive redshift estimators such as template cross-correlation. It also provides a natural means by which to identify outliers (e.g., misclassified spectra, spectra with anomalous features). We analyze 3835 SDSS spectra and show how our framework yields a more than 95% reduction in dimensionality. Finally, we show that the prediction error of the diffusion map-based regression approach is markedly smaller than that of a similar approach based on PCA, clearly demonstrating the superiority of diffusion maps over PCA for this regression task.

24 pages, 8 figures

References in corpus (3)

• The Sixth Data Release of the Sloan Digital Sky Survey
• Estimation of stellar atmospheric parameters from SDSS/SEGUE spectra
• Decoding the spectra of SDSS early-type galaxies: New indicators of age and recent star formation

Cited by in corpus (20)

• Results from the Supernova Photometric Classification Challenge
• The weirdest SDSS galaxies: results from an outlier detection algorithm
• Dimensionality Reduction of SDSS Spectra with Variational Autoencoders
• Reducing the Dimensionality of Data: Locally Linear Embedding of Sloan Galaxy Spectra
• Nonparametric Conditional Density Estimation in a High-Dimensional Regression Setting
• Semi-supervised Learning for Photometric Supernova Classification
• Photometric Redshift Estimation Using Spectral Connectivity Analysis
• A Spectral Series Approach to High-Dimensional Nonparametric Regression
• Machine Learning for Observational Cosmology
• Accurate parameter estimation for star formation history in galaxies using SDSS spectra
• The Data Big Bang and the Expanding Digital Universe: High-Dimensional, Complex and Massive Data Sets in an Inflationary Epoch
• Parametrising arbitrary galaxy morphologies: potentials and pitfalls
• The Twins Embedding of Type Ia Supernovae I: The Diversity of Spectra at Maximum Light
• BAYES-LOSVD: a bayesian framework for non-parametric extraction of the line-of-sight velocity distribution of galaxies
• Estimating Spectroscopic Redshifts by Using k Nearest Neighbors Regression I. Description of Method and Analysis
• Soft clustering analysis of galaxy morphologies: A worked example with SDSS
• Mapping the Similarities of Spectra: Global and Locally-biased Approaches to SDSS Galaxy Data
• Prototype selection for parameter estimation in complex models
• Local Two-Sample Testing: A New Tool for Analysing High-Dimensional Astronomical Data
• Mapping Topographic Structure in White Matter Pathways with Level Set Trees