Robust Machine Learning Applied to Astronomical Datasets I: Star-Galaxy Classification of the SDSS DR3 Using Decision Trees
arXiv:astro-ph/0606541 · doi:10.1086/507440
Abstract
We provide classifications for all 143 million non-repeat photometric objects in the Third Data Release of the Sloan Digital Sky Survey (SDSS) using decision trees trained on 477,068 objects with SDSS spectroscopic data. We demonstrate that these star/galaxy classifications are expected to be reliable for approximately 22 million objects with r < ~20. The general machine learning environment Data-to-Knowledge and supercomputing resources enabled extensive investigation of the decision tree parameter space. This work presents the first public release of objects classified in this way for an entire SDSS data release. The objects are classified as either galaxy, star or nsng (neither star nor galaxy), with an associated probability for each class. To demonstrate how to effectively make use of these classifications, we perform several important tests. First, we detail selection criteria within the probability space defined by the three classes to extract samples of stars and galaxies to a given completeness and efficiency. Second, we investigate the efficacy of the classifications and the effect of extrapolating from the spectroscopic regime by performing blind tests on objects in the SDSS, 2dF Galaxy Redshift and 2dF QSO Redshift (2QZ) surveys. Given the photometric limits of our spectroscopic training data, we effectively begin to extrapolate past our star-galaxy training set at r ~ 18. By comparing the number counts of our training sample with the classified sources, however, we find that our efficiencies appear to remain robust to r ~ 20. As a result, we expect our classifications to be accurate for 900,000 galaxies and 6.7 million stars, and remain robust via extrapolation for a total of 8.0 million galaxies and 13.9 million stars. [Abridged]
27 pages, 12 figures, to be published in ApJ, uses emulateapj.cls
References in corpus (7)
- The Galaxy Evolution Explorer: A Space Ultraviolet Survey Mission
- The Second Data Release of the Sloan Digital Sky Survey
- The Third Data Release of the Sloan Digital Sky Survey
- The 2dF QSO Redshift Survey - XII. The spectroscopic catalogue and luminosity function
- First Measurement of the Clustering Evolution of Photometrically-Classified Quasars
- A Census of Object Types and Redshift Estimates in the SDSS Photometric Catalog from a Trained Decision-Tree Classifier
- Class Discovery in Galaxy Classification
Cited by in corpus (59)
- Data Mining and Machine Learning in Astronomy
- Comparison of decision tree methods for finding active objects
- On Machine-Learned Classification of Variable Stars with Sparse and Noisy Time-Series Data
- Star-galaxy Classification Using Deep Convolutional Neural Networks
- Optimising Automatic Morphological Classification of Galaxies with Machine Learning and Deep Learning using Dark Energy Survey Imaging
- The DAWES review 10: The impact of deep learning for the analysis of galaxy surveys
- Decision Tree Classifiers for Star/Galaxy Separation
- Robust Machine Learning Applied to Astronomical Datasets III: Probabilistic Photometric Redshifts for Galaxies and Quasars in the SDSS and GALEX
- Eight-Dimensional Mid-Infrared/Optical Bayesian Quasar Selection
- Machine Learning and Cosmological Simulations II: Hydrodynamical Simulations
- Deep Transfer Learning for Star Cluster Classification: I. Application to the PHANGS-HST Survey
- Robust Machine Learning Applied to Astronomical Datasets II: Quantifying Photometric Redshifts for Quasars Using Instance-Based Learning
- Gamma-Ray Active Galactic Nucleus Type through Machine-Learning Algorithms
- The VIMOS Public Extragalactic Redshift Survey (VIPERS). A Support Vector Machine classification of galaxies, stars and AGNs
- J-PLUS: Morphological star/galaxy classification by PDF analysis
- A Hybrid Ensemble Learning Approach to Star-Galaxy Classification
- Machine learning Applied to Star-Galaxy-QSO Classification and Stellar Effective Temperature Regression
- Machine Learning and Cosmological Simulations I: Semi-Analytical Models
- KiDS-SQuaD II: Machine learning selection of bright extragalactic objects to search for new gravitationally lensed quasars
- On the discovery of stars, quasars, and galaxies in the Southern Hemisphere with S-PLUS DR2
- Finding rare objects and building pure samples: Probabilistic quasar classification from low resolution Gaia spectra
- Star-galaxy classification in the Dark Energy Survey Y1 dataset
- Predicting star formation properties of galaxies using deep learning
- Deep Horizon; a machine learning network that recovers accreting black hole parameters
- A Bayesian approach to star-galaxy classification
- TESS Data for Asteroseismology (T'DA) Stellar Variability Classification Pipeline: Set-Up and Application to the Kepler Q9 Data
- Sky Surveys
- Effect of training characteristics on object classification: an application using Boosted Decision Trees
- Photometric Classification of quasars from RCS-2 using Random Forest
- J-PLUS: Support Vector Machine Applied to STAR-GALAXY-QSOClassification
- Inferring physical properties of galaxies from their emission line spectra
- Use of neural networks for the identification of new z>=3.6 QSOs from FIRST-SDSS DR5
- The High Cadence Transient Survey (HITS): Compilation and characterization of light-curve catalogs
- Preparing for advanced LIGO: A Star-Galaxy Separation Catalog for the Palomar Transient Factory
- Photometric identification of compact galaxies, stars and quasars using multiple neural networks
- Searching for hot subdwarf stars from the LAMOST spectra. III. classifying the hot subdwarf stars from LAMOST DR4 using deep learning method
- Statistical process monitoring of artificial neural networks
- AutoSourceID-Classifier. Star-Galaxy Classification using a Convolutional Neural Network with Spatial Information
- A Machine Learning Approach For Classifying Low-mass X-ray Binaries Based On Their Compact Object Nature
- Scientific Data Mining in Astronomy
- A machine learning approach for identifying the counterparts of submillimetre galaxies and applications to the GOODS-North field
- Preparation for CSST: Star-galaxy Classification using a Rotationally Invariant Supervised Machine Learning Method
- Galaxy Spectra Networks (GaSNet). III. Generative pre-trained network for spectrum reconstruction, redshift estimate and anomaly detection
- J-PLUS: Bayesian object classification with a strum of BANNJOS
- A Morphological Classification Model to Identify Unresolved PanSTARRS1 Sources II: Update to the PS1 Point Source Catalog
- YOUNG Star detrending for Transiting Exoplanet Recovery (YOUNGSTER) II: Using Self-Organising Maps to explore young star variability in Sectors 1-13 of TESS data
- Decision table for classifying point sources based on FIRST and 2MASS databases
- On the usage of the probability integral transform to reduce the complexity of multi-way fuzzy decision trees in Big Data classification problems
- Robust Machine Learning Applied to Terascale Astronomical Datasets
- Photometric classification of QSOs from ALHAMBRA survey using random forest
- Neural Posterior Estimation for Cataloging Astronomical Images with Spatially Varying Backgrounds and Point Spread Functions
- A Morphological Model to Separate Resolved-Unresolved Sources in the DESI Legacy Surveys: Application in the LS4 Alert Stream
- The Next Generation Virgo Cluster Survey (NGVS). XL. The Morphological Classification of Virgo Cluster Galaxies
- Spectral Classification Using Restricted Boltzmann Machine
- The miniJPAS survey quasar selection I: Mock catalogues for classification
- Identifying AGN host galaxies by Machine Learning with HSC+WISE
- Using Machine Learning to Identify Extragalactic Globular Cluster Candidates from Ground-Based Photometric Surveys of M87
- Can AI Dream of Unseen Galaxies? Conditional Diffusion Model for Galaxy Morphology Augmentation
- Finding Fast Transients in Real Time Using Novel Light Curve Analysis Algorithm