Photometric Redshift Estimation Using Spectral Connectivity Analysis
arXiv:0906.0995 · doi:10.1111/j.1365-2966.2009.15236.x
Abstract
The development of fast and accurate methods of photometric redshift estimation is a vital step towards being able to fully utilize the data of next-generation surveys within precision cosmology. In this paper we apply a specific approach to spectral connectivity analysis (SCA; Lee & Wasserman 2009) called diffusion map. SCA is a class of non-linear techniques for transforming observed data (e.g., photometric colours for each galaxy, where the data lie on a complex subset of p-dimensional space) to a simpler, more natural coordinate system wherein we apply regression to make redshift predictions. As SCA relies upon eigen-decomposition, our training set size is limited to ~ 10,000 galaxies; we use the Nystrom extension to quickly estimate diffusion coordinates for objects not in the training set. We apply our method to 350,738 SDSS main sample galaxies, 29,816 SDSS luminous red galaxies, and 5,223 galaxies from DEEP2 with CFHTLS ugriz photometry. For all three datasets, we achieve prediction accuracies on par with previous analyses, and find that use of the Nystrom extension leads to a negligible loss of prediction accuracy relative to that achieved with the training sets. As in some previous analyses (e.g., Collister & Lahav 2004, Ball et al. 2008), we observe that our predictions are generally too high (low) in the low (high) redshift regimes. We demonstrate that this is a manifestation of attenuation bias, wherein measurement error (i.e., uncertainty in diffusion coordinates due to uncertainty in the measured fluxes/magnitudes) reduces the slope of the best-fit regression line. Mitigation of this bias is necessary if we are to use photometric redshift estimates produced by computationally efficient empirical methods in precision cosmology.
arXiv commentResubmitted to MNRAS (11 pages, 8 figures)
References in corpus (26)
- Spectroscopic Target Selection in the Sloan Digital Sky Survey: The Main Galaxy Sample
- Accurate photometric redshifts for the CFHT Legacy Survey calibrated using the VIMOS VLT Deep Survey
- COSMOS Photometric Redshifts with 30-bands for 2-deg2
- Bayesian photometric redshift estimation
- Spectroscopic Target Selection for the Sloan Digital Sky Survey: The Luminous Red Galaxy Sample
- The All-wavelength Extended Groth Strip International Survey (AEGIS) Data Sets
- Science Objectives and Early Results of the DEEP2 Redshift Survey
- ANNz: estimating photometric redshifts using artificial neural networks
- A new catalog of photometric redshifts in the Hubble Deep Field
- Slicing Through Multicolor Space: Galaxy Redshifts From Broadband Photometry
- Calibrating Redshift Distributions Beyond Spectroscopic Limits with Cross-Correlations
- Effect of Photometric Redshift Uncertainties on Weak Lensing Tomography
- The Zurich Extragalactic Bayesian Redshift Analyzer (ZEBRA) and its first application: COSMOS
- The DEEP2 Galaxy Redshift Survey: The Relationship Between Galaxy Properties and Environment at z ~ 1
- MegaPipe: the MegaCam image stacking pipeline at the Canadian Astronomical Data Centre
- Evolution and Color-Dependence of the Galaxy Angular Correlation Function: 350,000 Galaxies in 5 Square Degrees
- A Galaxy Photometric Redshift Catalog for the Sloan Digital Sky Survey Data Release 6
- Galaxy Types in the Sloan Digital Sky Survey Using Supervised Artificial Neural Networks
- Photometric redshifts with the Multilayer Perceptron Neural Network: application to the HDF-S and SDSS
- Robust Machine Learning Applied to Astronomical Datasets III: Probabilistic Photometric Redshifts for Galaxies and Quasars in the SDSS and GALEX
- Sloan Digital Sky Survey Imaging of Low Galactic Latitude Fields: Technical Summary and Data Release
- The Ultraviolet Luminosity Function of GALEX Galaxies at Photometric Redshifts Between 0.07 and 0.25
- Exploiting Low-Dimensional Structure in Astronomical Spectra
- Reliable Eigenspectra for New Generation Surveys
- A New Technique for Galaxy Photometric Redshifts in the Sloan Digital Sky Survey
- An Improved Photometric Calibration of the Sloan Digital Sky Survey Imaging Data
Cited by in corpus (27)
- The DEEP2 Galaxy Redshift Survey: Design, Observations, Data Reduction, and Redshifts
- TPZ : Photometric redshift PDFs and ancillary information by using prediction trees and random forests
- ArborZ: Photometric Redshifts Using Boosted Decision Trees
- On using angular cross-correlations to determine source redshift distributions
- Using neural networks to estimate redshift distributions. An application to CFHTLenS
- A General Study of the Influence of Catastrophic Photometric Redshift Errors on Cosmology with Cosmic Shear Tomography
- A catalogue of photometric redshifts for the SDSS-DR9 galaxies
- Exhausting the Information: Novel Bayesian Combination of Photometric Redshift PDFs
- Nonparametric Conditional Density Estimation in a High-Dimensional Regression Setting
- Subluminous Type Ia Supernovae at High Redshift from the Supernova Legacy Survey
- Semi-supervised Learning for Photometric Supernova Classification
- Machine Learning based photometric redshifts for the KiDS ESO DR2 galaxies
- Conditional Density Estimation Tools in Python and R with Applications to Photometric Redshifts and Likelihood-Free Cosmological Inference
- Astroinformatics of galaxies and quasars: a new general method for photometric redshifts estimation
- STACCATO: A Novel Solution to Supernova Photometric Classification with Biased Training Sets
- Photometric Redshifts from SDSS Images with an Interpretable Deep Capsule Network
- A new method to improve photometric redshift reconstruction. Applications to the Large Synoptic Survey Telescope
- Assessing the photometric redshift precision of the S-PLUS survey: the Stripe-82 as a test-case
- Improving Correlation Function Fitting with Ridge Regression: Application to Cross-Correlation Reconstruction
- Comparison of Observed Galaxy Properties with Semianalytic Model Predictions using Machine Learning
- Calibrating photometric redshift distributions with cross-correlations
- Photometric Redshift Estimation for Quasars by Integration of KNN and SVM
- GeneticKNN: A Weighted KNN Approach Supported by Genetic Algorithm for Photometric Redshift Estimation of Quasars
- CLaSPS: a new methodology for Knowledge extraction from complex astronomical dataset
- The CluMPR Galaxy Cluster-Finding Algorithm and DESI Legacy Survey Galaxy Cluster Catalogue
- Prototype selection for parameter estimation in complex models
- Local Two-Sample Testing: A New Tool for Analysing High-Dimensional Astronomical Data