SOMz: photometric redshift PDFs with self organizing maps and random atlas
arXiv:1312.5753 · doi:10.1093/mnras/stt2456
Abstract
In this paper we explore the applicability of the unsupervised machine learning technique of Self Organizing Maps (SOM) to estimate galaxy photometric redshift probability density functions (PDFs). This technique takes a spectroscopic training set, and maps the photometric attributes, but not the redshifts, to a two dimensional surface by using a process of competitive learning where neurons compete to more closely resemble the training data multidimensional space. The key feature of a SOM is that it retains the topology of the input set, revealing correlations between the attributes that are not easily identified. We test three different 2D topological mapping: rectangular, hexagonal, and spherical, by using data from the DEEP2 survey. We also explore different implementations and boundary conditions on the map and also introduce the idea of a random atlas where a large number of different maps are created and their individual predictions are aggregated to produce a more robust photometric redshift PDF. We also introduced a new metric, the -score, which efficiently incorporates different metrics, making it easier to compare different results (from different parameters or different photometric redshift codes). We find that by using a spherical topology mapping we obtain a better representation of the underlying multidimensional topology, which provides more accurate results that are comparable to other, state-of-the-art machine learning algorithms. Our results illustrate that unsupervised approaches have great potential for many astronomical problems, and in particular for the computation of photometric redshifts.
14 pages, 8 figures. Accepted for publication in MNRAS. The code can be found at http://lcdm.astro.illinois.edu/research/SOMZ.html
References in corpus (4)
- Precision photometric redshift calibration for galaxy-galaxy weak lensing
- Robust Machine Learning Applied to Astronomical Datasets III: Probabilistic Photometric Redshifts for Galaxies and Quasars in the SDSS and GALEX
- Extended Photometry for the DEEP2 Galaxy Redshift Survey: A Testbed for Photometric Redshift Experiments
- ASPECT: A spectra clustering tool for exploration of large spectral surveys
Cited by in corpus (70)
- The galaxy cluster mass scale and its impact on cosmological constraints from the cluster population
- Mapping the Galaxy Color-Redshift Relation: Optimal Photometric Redshift Calibration Strategies for Cosmology Surveys
- Dark Energy Survey Year 1 Results: Redshift distributions of the weak lensing source galaxies
- ANNz2 - photometric redshift and probability distribution function estimation using machine learning
- Dark Energy Survey Year 3 Results: Redshift Calibration of the Weak Lensing Source Galaxies
- Surveying the reach and maturity of machine learning and artificial intelligence in astronomy
- K2 Variable Catalogue II: Machine Learning Classification of Variable Stars and Eclipsing Binaries in K2 Fields 0-4
- Phenotypic redshifts with self-organizing maps: A novel method to characterize redshift distributions of source galaxies for weak lensing
- All-purpose, all-sky photometric redshifts for the Legacy Imaging Surveys Data Release 8
- An automatic taxonomy of galaxy morphology using unsupervised machine learning
- Photometric redshifts for the next generation of deep radio continuum surveys - I: Template fitting
- Identifying Strong Lenses with Unsupervised Machine Learning using Convolutional Autoencoder
- METAPHOR: A machine learning based method for the probability density estimation of photometric redshifts
- Anomaly detection for machine learning redshifts applied to SDSS galaxies
- Beyond the Hubble Sequence -- Exploring Galaxy Morphology with Unsupervised Machine Learning
- Exhausting the Information: Novel Bayesian Combination of Photometric Redshift PDFs
- Photometric redshifts for the next generation of deep radio continuum surveys - II. Gaussian processes and hybrid estimates
- A Hybrid Ensemble Learning Approach to Star-Galaxy Classification
- Transit Shapes and Self Organising Maps as a Tool for Ranking Planetary Candidates: Application to Kepler and K2
- A machine learning approach to galaxy properties: joint redshift-stellar mass probability distributions with Random Forest
- Photometric redshifts for galaxies in the Subaru Hyper Suprime-Cam and unWISE and a catalogue of identified clusters of galaxies
- A review of unsupervised learning in astronomy
- Horizon-AGN virtual observatory -- 2: Template-free estimates of galaxy properties from colours
- Halo Concentration, Galaxy Red Fraction, and Gas Properties of Optically-defined Merging Clusters
- Automatic vetting of planet candidates from ground based surveys: Machine learning with NGTS
- Photometric Redshifts from SDSS Images with an Interpretable Deep Capsule Network
- Improving the reliability of photometric redshift with machine learning
- Galaxy-Galaxy Lensing in HSC: Validation Tests and the Impact of Heterogeneous Spectroscopic Training Sets
- Photometric Redshift Estimation of BASS DR3 Quasars by Machine Learning
- Photometric redshifts with machine learning, lights and shadows on a complex data science use case
- Approximating photo- PDFs for large surveys
- Assessing the photometric redshift precision of the S-PLUS survey: the Stripe-82 as a test-case
- Stacking for machine learning redshifts applied to SDSS galaxies
- Statistical analysis of probability density functions for photometric redshifts through the KiDS-ESO-DR3 galaxies
- A Unified Framework for Constructing, Tuning and Assessing Photometric Redshift Density Estimates in a Selection Bias Setting
- Exploring Photometric Redshifts as an Optimization Problem: An Ensemble MCMC and Simulated Annealing-Driven Template-Fitting Approach
- How to Find Variable Active Galactic Nuclei with Machine Learning
- MUSE spectroscopy and deep observations of a unique compact JWST target, lensing cluster CLIO
- Sparse Representation of Photometric Redshift PDFs: Preparing for Petascale Astronomy
- The eROSITA Final Equatorial-Depth Survey (eFEDS): X-ray properties of Subaru optically-selected clusters
- Active gas features in three HSC-SSP CAMIRA clusters revealed by high angular resolution analysis of MUSTANG-2 SZE and XXL X-ray observations
- Photometric Redshift Estimation with Galaxy Morphology using Self-Organizing Maps
- Classifying galaxy spectra at 0.5<z<1 with self-organizing maps
- A Machine Learning Approach to Predict Missing Flux Densities in Multi-band Galaxy Surveys
- Multiwavelength study of X-ray Luminous Clusters in the Hyper Suprime-Cam Subaru Strategic Program S16A field
- Gaia eclipsing binary and multiple systems. Supervised classification and self-organizing maps
- The SRG/eROSITA All-Sky Survey : Subaru/HSC-SSP weak-lensing mass measurements for the eRASS1 Galaxy Clusters
- Weak Lensing Measurement of Filamentary Structure with the SDSS BOSS and Subaru Hyper Suprime-Cam Data
- Data Deluge in Astrophysics: Photometric Redshifts as a Template Use Case
- Identifying new high-confidence polluted white dwarf candidates using Gaia XP spectra and Self-Organizing Maps
- Rotation and flipping invariant self-organizing maps with astronomical images: A cookbook and application to the VLA Sky Survey QuickLook images
- The catalog-to-cosmology framework for weak lensing and galaxy clustering for LSST
- The many flavours of photometric redshifts
- The effect of emission lines on the performance of photometric redshift estimation algorithms
- Improved photometric redshifts with colour-constrained galaxy templates for future wide-area surveys
- Rejection criteria based on outliers in the KiDS photometric redshifts and PDF distributions derived by machine learning
- Efficient Identification of Broad Absorption Line Quasars using Dimensionality Reduction and Machine Learning
- YOUNG Star detrending for Transiting Exoplanet Recovery (YOUNGSTER) II: Using Self-Organising Maps to explore young star variability in Sectors 1-13 of TESS data
- Galaxy Manifold: Characterizing and understanding galaxies with two parameters
- CLAP. I. Resolving miscalibration for deep learning-based galaxy photometric redshift estimation
- On the Clustering of Compact Galaxy Pairs in Dark Matter Haloes
- Learn from every mistake! Hierarchical information combination in astronomy
- Optimizing Redshift Distribution Inference through Joint Self-Calibration and Clustering-Redshift Synergy
- Machine Learning for Exploring Spatial Affordance Patterns
- The S-PLUS Fornax Project (S+FP): An extragalactic catalog covering 5 virial radii around NGC 1399 with galaxy properties
- Probability density estimation of photometric redshifts based on machine learning
- Signatures of large-scale cold fronts in the optically-selected merging cluster HSC J085024+001536
- Dark matter halos of luminous AGNs from galaxy-galaxy lensing with the HSC Subaru Strategic Program
- Photometric Redshift Estimation with Convolutional Neural Networks and Galaxy Images: A Case Study of Resolving Biases in Data-Driven Methods
- From Redshift to Real Space: Combining Linear Theory With Neural Networks