Merger or Not: Accounting for Human Biases in Identifying Galactic Merger Signatures

Abstract

Significant galaxy mergers throughout cosmic time play a fundamental role in theories of galaxy evolution. The widespread usage of human classifiers to visually assess whether galaxies are in merging systems remains a fundamental component of many morphology studies. Studies that employ human classifiers usually construct a control sample, and rely on the assumption that the bias introduced by using humans will be evenly applied to all samples. In this work, we test this assumption and develop methods to correct for it. Using the standard binomial statistical methods employed in many morphology studies, we find that the merger fraction, error, and the significance of the difference between two samples are dependent on the intrinsic merger fraction of any given sample. We propose a method of quantifying merger biases of individual human classifiers and incorporate these biases into a full probabilistic model to determine the merger fraction and the probability of an individual galaxy being in a merger. Using 14 simulated human responses and accuracies, we are able to correctly label a galaxy as ''merger'' or ''isolated'' to within 1\% of the truth. Using 14 real human responses on a set of realistic mock galaxy simulation snapshots our model is able to recover the pre-coalesced merger fraction to within 10\%. Our method can not only increase the accuracy of studies probing the merger state of galaxies at cosmic noon, but also can be used to construct more accurate training sets in machine learning studies that use human classified data-sets.

23 pages, 16 figures, accepted for publication in ApJ, https://github.com/elambrid/merger_or_not

References in corpus (18)

• The NumPy array: a structure for efficient numerical computation
• Cosmic Star Formation History
• The EAGLE project: Simulating the evolution and assembly of galaxies and their environments
• Rotation-invariant convolutional neural networks for galaxy morphology prediction
• The Evolution of Galaxy Structure over Cosmic Time
• Evidence for Quasar Activity Triggered by Galaxy Mergers in HST Observations of Dust-reddened Quasars
• A definitive merger-AGN connection at z~0 with CFIS: mergers have an excess of AGN and AGN hosts are more frequently disturbed
• Merging and Clustering of the Swift BAT AGN Sample
• HST WFC3/IR Observations of Active Galactic Nucleus Host Galaxies at z~2: Supermassive Black Holes Grow in Disk Galaxies
• Observational constraints on the merger history of galaxies since $z\approx 6$: Probabilistic galaxy pair counts in the CANDELS fields
• Host galaxies of luminous z$\sim$0.6 quasars: Major mergers are not prevalent at the highest AGN luminosities
• Major Merging History in CANDELS. I. Evolution of the Incidence of Massive Galaxy-Galaxy Pairs from z=3 to z~0
• Identifying Galaxy Mergers in Observations and Simulations with Deep Learning
• Diverse Structural Evolution at z > 1 in Cosmologically Simulated Galaxies
• The host galaxies of X-ray selected Active Galactic Nuclei to z=2.5: Structure, star-formation and their relationships from CANDELS and Herschel/PACS
• Distinguishing Mergers and Disks in High Redshift Observations of Galaxy Kinematics
• A significant excess in major merger rate for AGNs with the highest Eddington ratios at z<0.2
• Piercing through Highly Obscured and Compton-thick AGNs in the Chandra Deep Fields. II. Are Highly Obscured AGNs the Missing Link in the Merger-Triggered AGN-Galaxy Coevolution Models?