Separation of pulsar signals from noise with supervised machine learning algorithms

Abstract

We evaluate the performance of four different machine learning (ML) algorithms: an Artificial Neural Network Multi-Layer Perceptron (ANN MLP ), Adaboost, Gradient Boosting Classifier (GBC), XGBoost, for the separation of pulsars from radio frequency interference (RFI) and other sources of noise, using a dataset obtained from the post-processing of a pulsar search pi peline. This dataset was previously used for cross-validation of the SPINN-based machine learning engine, used for the reprocessing of HTRU-S survey data arXiv:1406.3627. We have used Synthetic Minority Over-sampling Technique (SMOTE) to deal with high class imbalance in the dataset. We report a variety of quality scores from all four of these algorithms on both the non-SMOTE and SMOTE datasets. For all the above ML methods, we report high accuracy and G-mean in both the non-SMOTE and SMOTE cases. We study the feature importances using Adaboost, GBC, and XGBoost and also from the minimum Redundancy Maximum Relevance approach to report algorithm-agnostic feature ranking. From these methods, we find that the signal to noise of the folded profile to be the best feature. We find that all the ML algorithms report FPRs about an order of magnitude lower than the corresponding FPRs obtained in arXiv:1406.3627, for the same recall value.

14 pages, 2 figures. Accepted for publication in Astronomy and Computing

References in corpus (18)

• A bright millisecond radio burst of extragalactic origin
• The Blanco Cosmology Survey: Data Acquisition, Processing, Calibration, Quality Diagnostics and Data Release
• Fifty Years of Pulsar Candidate Selection: From simple filters to a new principled real-time classification approach
• Pulsar braking and the P-Pdot diagram
• Discovery of 28 pulsars using new techniques for sorting pulsar candidates
• SPINN: a straightforward machine learning solution to the pulsar candidate selection problem
• A Machine Learns to Predict the Stability of Tightly Packed Planetary Systems
• 3FGL Demographics Outside the Galactic Plane using Supervised Machine Learning: Pulsar and Dark Matter Subhalo Interpretations
• Photometric classification of type Ia supernovae in the SuperNova Legacy Survey with supervised learning
• Feature importance for machine learning redshifts applied to SDSS galaxies
• A machine learned classifier for RR Lyrae in the VVV survey
• A Machine Learning Classifier for Fast Radio Burst Detection at the VLBA
• Detection of Dispersed Radio Pulses: A machine learning approach to candidate identification and classification
• An investigation of pulsar searching techniques with the Fast Folding Algorithm
• Stacking machine learning classifiers to identify Higgs bosons at the LHC
• Effect of training characteristics on object classification: an application using Boosted Decision Trees
• Supervised Ensemble Classification of Kepler Variable Stars
• ASTErIsM - Application of topometric clustering algorithms in automatic galaxy detection and classification

Cited by in corpus (27)

• FETCH: A deep-learning based classifier for fast transient classification
• Surveying the reach and maturity of machine learning and artificial intelligence in astronomy
• A Machine Learning Based Morphological Classification of 14,245 Radio AGNs Selected From The Best-Heckman Sample
• Single-pulse classifier for the LOFAR Tied-Array All-sky Survey
• Efficient Selection of Quasar Candidates Based on Optical and Infrared Photometric Data Using Machine Learning
• Pulsar Candidate Identification Using Semi-Supervised Generative Adversarial Networks
• Transferring spectroscopic stellar labels to 217 million Gaia DR3 XP stars with SHBoost
• Galaxy Morphology Classification using Neural Ordinary Differential Equations
• Pushchino multibeam pulsar search: I. Targeted search of weak pulsars
• The Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC): Selection of a performance metric for classification probabilities balancing diverse science goals
• Pulsars Detection by Machine Learning with Very Few Features
• Identification of BASS DR3 Sources as Stars, Galaxies and Quasars by XGBoost
• Classifying Stars, Galaxies and AGN in CLAUDS+HSC-SSP Using Gradient Boosted Decision Trees
• Identifying MgII Narrow Absorption Lines with Deep Learning
• Analyzing the Galactic pulsar distribution with machine learning
• Classification of the \emph{Fermi}-LAT Blazar Candidates of Uncertain type using eXtreme Gradient Boosting
• Enhanced Astronomical Source Classification with Integration of Attention Mechanisms and Vision Transformers
• Pushchino multibeams pulsar search. IV. Detection of new pulsars at declinations -9o < δ< +55o
• A test of the evolution of gas depletion factor in galaxy clusters using strong gravitational lensing systems
• Identification of emission-line stars in transition phase from pre-main sequence to main sequence
• Vela Pulsar: Single Pulses Analysis with Machine Learning Techniques
• Search for fast radio transients using Arecibo drift-scan observations at 1.4 GHz
• Cosmic Ray Rejection with Attention Augmented Deep Learning
• Probabilistic learning for pulsar classification
• Dealing with the data imbalance problem on pulsar candidates sifting based on feature selection
• Classification of a New X-ray Catalog of Likely Counterparts to 4FGL-DR4 Unassociated Gamma-ray Sources Using a Neural Network
• Comparison of symbolic regression algorithms in Star/galaxy/quasar separation