Labeling Bias in Galaxy Morphologies

Abstract

We present a metric to quantify systematic labeling bias in galaxy morphology data sets stemming from the quality of the labeled data. This labeling bias is independent from labeling errors and requires knowledge about the intrinsic properties of the data with respect to the observed properties. We conduct a relative comparison of label bias for different low redshift galaxy morphology data sets. We show our metric is able to recover previous de-biasing procedures based on redshift as biasing parameter. By using the image resolution instead, we find biases that have not been addressed. We find that the morphologies based on supervised machine-learning trained over features such as colors, shape, and concentration show significantly less bias than morphologies based on expert or citizen-science classifiers. This result holds even when there is underlying bias present in the training sets used in the supervised machine learning process. We use catalog simulations to validate our bias metric, and show how to bin the multidimensional intrinsic and observed galaxy properties used in the bias quantification. Our approach is designed to work on any other labeled multidimensional data sets and the code is publicly available.

References in corpus (24)

• The Sloan Digital Sky Survey: Technical Summary
• The Seventh Data Release of the Sloan Digital Sky Survey
• Nine-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Cosmological Parameter Results
• CANDELS: The Cosmic Assembly Near-infrared Deep Extragalactic Legacy Survey
• Galaxy Zoo : Morphologies derived from visual inspection of galaxies from the Sloan Digital Sky Survey
• Rotation-invariant convolutional neural networks for galaxy morphology prediction
• Observational evidence for AGN feedback in early-type galaxies
• Galaxy Zoo 1 : Data Release of Morphological Classifications for nearly 900,000 galaxies
• Galaxy Zoo 2: detailed morphological classifications for 304,122 galaxies from the Sloan Digital Sky Survey
• Galaxy Zoo: the dependence of morphology and colour on environment
• A Catalog of Detailed Visual Morphological Classifications for 14034 Galaxies in the Sloan Digital Sky Survey
• The Mass Assembly Histories of Galaxies of Various Morphologies in the GOODS Fields
• A catalog of visual-like morphologies in the 5 CANDELS fields using deep-learning
• Revisiting the Hubble sequence in the SDSS DR7 spectroscopic sample: a publicly available bayesian automated classification
• The zCOSMOS Redshift Survey: the role of environment and stellar mass in shaping the rise of the morphology-density relation from z~1
• Early type galaxies have been the predominant morphological class for massive galaxies since only z~1
• Galaxy Types in the Sloan Digital Sky Survey Using Supervised Artificial Neural Networks
• A Catalogue of Morphologically Classified Galaxies from the Sloan Digital Sky Survey: North Equatorial Region
• CANDELS Visual Classifications: Scheme, Data Release, and First Results
• Galaxy Zoo: Quantitative Visual Morphological Classifications for 48,000 galaxies from CANDELS
• Galaxy Zoo: Morphological Classifications for 120,000 Galaxies in HST Legacy Imaging
• The morphologies of massive galaxies from z~3 - Witnessing the 2 channels of bulge growth
• Automated Galaxy Morphology: A Fourier Approach
• The Morphological Transformation of Red Sequence Galaxies in Clusters since $z\sim 1$

Cited by in corpus (9)

• Galaxy Zoo: Probabilistic Morphology through Bayesian CNNs and Active Learning
• Surveying the reach and maturity of machine learning and artificial intelligence in astronomy
• Machine learning technique for morphological classification of galaxies from the SDSS. I. Photometry-based approach
• A review of unsupervised learning in astronomy
• Do AGN triggering mechanisms vary with radio power? I.Optical morphologies of radio-intermediate HERGs
• Machine learning technique for morphological classification of galaxies from the SDSS. III. Image-based inference of detailed features
• Machine learning technique for morphological classification of galaxies from SDSS. II. The image-based morphological catalogs of galaxies at 0.02<z<0.1
• Galaxy Morphological Classification with Manifold Learning
• Mock Observations: Morphological Analysis of Galaxies in TNG100 Simulations