Photometric Redshift Estimation Using Spectral Connectivity Analysis
arXiv:0906.0995 · doi:10.1111/j.1365-2966.2009.15236.x
Abstract
The development of fast and accurate methods of photometric redshift estimation is a vital step towards being able to fully utilize the data of next-generation surveys within precision cosmology. In this paper we apply a specific approach to spectral connectivity analysis (SCA; Lee & Wasserman 2009) called diffusion map. SCA is a class of non-linear techniques for transforming observed data (e.g., photometric colours for each galaxy, where the data lie on a complex subset of p-dimensional space) to a simpler, more natural coordinate system wherein we apply regression to make redshift predictions. As SCA relies upon eigen-decomposition, our training set size is limited to ~ 10,000 galaxies; we use the Nystrom extension to quickly estimate diffusion coordinates for objects not in the training set. We apply our method to 350,738 SDSS main sample galaxies, 29,816 SDSS luminous red galaxies, and 5,223 galaxies from DEEP2 with CFHTLS ugriz photometry. For all three datasets, we achieve prediction accuracies on par with previous analyses, and find that use of the Nystrom extension leads to a negligible loss of prediction accuracy relative to that achieved with the training sets. As in some previous analyses (e.g., Collister & Lahav 2004, Ball et al. 2008), we observe that our predictions are generally too high (low) in the low (high) redshift regimes. We demonstrate that this is a manifestation of attenuation bias, wherein measurement error (i.e., uncertainty in diffusion coordinates due to uncertainty in the measured fluxes/magnitudes) reduces the slope of the best-fit regression line. Mitigation of this bias is necessary if we are to use photometric redshift estimates produced by computationally efficient empirical methods in precision cosmology.
Resubmitted to MNRAS (11 pages, 8 figures)
References in corpus (11)
- COSMOS Photometric Redshifts with 30-bands for 2-deg2
- The All-wavelength Extended Groth Strip International Survey (AEGIS) Data Sets
- Calibrating Redshift Distributions Beyond Spectroscopic Limits with Cross-Correlations
- The Zurich Extragalactic Bayesian Redshift Analyzer (ZEBRA) and its first application: COSMOS
- The DEEP2 Galaxy Redshift Survey: The Relationship Between Galaxy Properties and Environment at z ~ 1
- MegaPipe: the MegaCam image stacking pipeline at the Canadian Astronomical Data Centre
- A Galaxy Photometric Redshift Catalog for the Sloan Digital Sky Survey Data Release 6
- Robust Machine Learning Applied to Astronomical Datasets III: Probabilistic Photometric Redshifts for Galaxies and Quasars in the SDSS and GALEX
- Reliable Eigenspectra for New Generation Surveys
- A New Technique for Galaxy Photometric Redshifts in the Sloan Digital Sky Survey
- An Improved Photometric Calibration of the Sloan Digital Sky Survey Imaging Data
Cited by in corpus (27)
- The DEEP2 Galaxy Redshift Survey: Design, Observations, Data Reduction, and Redshifts
- TPZ : Photometric redshift PDFs and ancillary information by using prediction trees and random forests
- ArborZ: Photometric Redshifts Using Boosted Decision Trees
- On using angular cross-correlations to determine source redshift distributions
- Using neural networks to estimate redshift distributions. An application to CFHTLenS
- A General Study of the Influence of Catastrophic Photometric Redshift Errors on Cosmology with Cosmic Shear Tomography
- A catalogue of photometric redshifts for the SDSS-DR9 galaxies
- Exhausting the Information: Novel Bayesian Combination of Photometric Redshift PDFs
- Nonparametric Conditional Density Estimation in a High-Dimensional Regression Setting
- Subluminous Type Ia Supernovae at High Redshift from the Supernova Legacy Survey
- Semi-supervised Learning for Photometric Supernova Classification
- Machine Learning based photometric redshifts for the KiDS ESO DR2 galaxies
- Conditional Density Estimation Tools in Python and R with Applications to Photometric Redshifts and Likelihood-Free Cosmological Inference
- Astroinformatics of galaxies and quasars: a new general method for photometric redshifts estimation
- STACCATO: A Novel Solution to Supernova Photometric Classification with Biased Training Sets
- Photometric Redshifts from SDSS Images with an Interpretable Deep Capsule Network
- A new method to improve photometric redshift reconstruction. Applications to the Large Synoptic Survey Telescope
- Assessing the photometric redshift precision of the S-PLUS survey: the Stripe-82 as a test-case
- Improving Correlation Function Fitting with Ridge Regression: Application to Cross-Correlation Reconstruction
- Comparison of Observed Galaxy Properties with Semianalytic Model Predictions using Machine Learning
- Calibrating photometric redshift distributions with cross-correlations
- Photometric Redshift Estimation for Quasars by Integration of KNN and SVM
- GeneticKNN: A Weighted KNN Approach Supported by Genetic Algorithm for Photometric Redshift Estimation of Quasars
- CLaSPS: a new methodology for Knowledge extraction from complex astronomical dataset
- The CluMPR Galaxy Cluster-Finding Algorithm and DESI Legacy Survey Galaxy Cluster Catalogue
- Prototype selection for parameter estimation in complex models
- Local Two-Sample Testing: A New Tool for Analysing High-Dimensional Astronomical Data