Anomaly detection for machine learning redshifts applied to SDSS galaxies

Abstract

We present an analysis of anomaly detection for machine learning redshift estimation. Anomaly detection allows the removal of poor training examples, which can adversely influence redshift estimates. Anomalous training examples may be photometric galaxies with incorrect spectroscopic redshifts, or galaxies with one or more poorly measured photometric quantity. We select 2.5 million 'clean' SDSS DR12 galaxies with reliable spectroscopic redshifts, and 6730 'anomalous' galaxies with spectroscopic redshift measurements which are flagged as unreliable. We contaminate the clean base galaxy sample with galaxies with unreliable redshifts and attempt to recover the contaminating galaxies using the Elliptical Envelope technique. We then train four machine learning architectures for redshift analysis on both the contaminated sample and on the preprocessed 'anomaly-removed' sample and measure redshift statistics on a clean validation sample generated without any preprocessing. We find an improvement on all measured statistics of up to 80% when training on the anomaly removed sample as compared with training on the contaminated sample for each of the machine learning routines explored. We further describe a method to estimate the contamination fraction of a base data sample.

13 pages, 8 figures, 1 table, minor text updates to macth MNRAS accepted version

References in corpus (6)

• The 2.5 m Telescope of the Sloan Digital Sky Survey
• K-corrections and filter transformations in the ultraviolet, optical, and near infrared
• Photometric redshift analysis in the Dark Energy Survey Science Verification data
• Using Galaxy Two-point Correlation Functions to Determine the Redshift Distributions of Galaxies Binned by Photometric Redshift
• Feature importance for machine learning redshifts applied to SDSS galaxies
• Data augmentation for machine learning redshifts applied to SDSS galaxies

Cited by in corpus (21)

• Surveying the reach and maturity of machine learning and artificial intelligence in astronomy
• Anomaly detection in the Zwicky Transient Facility DR3
• Morpho-z: improving photometric redshifts with galaxy morphology
• Active Anomaly Detection for time-domain discoveries
• A comprehensive statistical study on gamma-ray bursts
• Data mining techniques on astronomical spectra data. II : Classification Analysis
• Photometric redshifts with machine learning, lights and shadows on a complex data science use case
• Stacking for machine learning redshifts applied to SDSS galaxies
• Autoencoding Galaxy Spectra II: Redshift Invariance and Outlier Detection
• Inferring physical properties of galaxies from their emission line spectra
• Band Selection from Hyperspectral Images Using Attention-based Convolutional Neural Networks
• Decoding Dark Matter Substructure without Supervision
• Data Deluge in Astrophysics: Photometric Redshifts as a Template Use Case
• Dimension Estimation Using Autoencoders
• Merged or monolithic? Using machine-learning to reconstruct the dynamical history of simulated star clusters
• Tuning target selection algorithms to improve galaxy redshift estimates
• Data challenges as a tool for time-domain astronomy
• FNet II: Spectral Classification of Quasars, Galaxies, Stars, and broad absorption line (BAL) Quasars
• The many flavours of photometric redshifts
• Spectroscopic observations of the machine-learning selected anomaly catalogue from the AllWISE Sky Survey
• Auto-outlier Fusion Technique for Chest X-ray classification with Multi-head Attention Mechanism