Anomaly Detection and Radio-frequency Interference Classification with Unsupervised Learning in Narrowband Radio Technosignature Searches

Abstract

The search for radio technosignatures is an anomaly detection problem: Candidate signals represent needles of interest in the proverbial haystack of radio-frequency interference (RFI). Current search frameworks find an enormity of false-positive signals, especially in large surveys, requiring manual follow-up to a sometimes prohibitive degree. Unsupervised learning provides an algorithmic way to winnow the most anomalous signals from the chaff, as well as group together RFI signals that bear morphological similarities. We present GLOBULAR (Grouping Low-frequency Observations By Unsupervised Learning After Reduction) clustering, a signal processing method that uses HDBSCAN to reduce the false-positive rate and isolate outlier signals for further analysis. When combined with a standard narrowband signal detection and spatial filtering pipeline, such as turboSETI, GLOBULAR clustering offers significant improvements in the false-positive rate over the standard pipeline alone, suggesting dramatic potential for the amelioration of manual follow-up requirements for future large surveys. By removing RFI signals in regions of high spectral occupancy, GLOBULAR clustering may also enable the detection of signals missed by the standard pipeline. We benchmark our method against the Choza et al. turboSETI-only search of 97 nearby galaxies at the L band, demonstrating a false-positive hit reduction rate of 93.1% and a false-positive event reduction rate of 99.3%.

21 pages, 14 figures

References in corpus (36)

• Scikit-learn: Machine Learning in Python
• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• Array Programming with NumPy
• Astropy: A Community Python Package for Astronomy
• The Astropy Project: Sustaining and Growing a Community-oriented Open-source Project and the Latest Major Release (v5.0) of the Core Package
• Binary companions of evolved stars in APOGEE DR14: Search method and catalog of ~5,000 companions
• A morphological algorithm for improving radio-frequency interference detection
• Post-correlation radio frequency interference classification methods
• Periodograms for Multiband Astronomical Time Series
• The Breakthrough Listen Search for Intelligent Life: 1.1-1.9 GHz observations of 692 Nearby Stars
• The Breakthrough Listen Search for Intelligent Life: Observations of 1327 Nearby Stars over 1.10-3.45 GHz
• A 1.1 to 1.9 GHz SETI Survey of the Kepler Field: I. A Search for Narrow-band Emission from Select Targets
• The Breakthrough Listen Search for Intelligent Life: Target Selection of Nearby Stars and Galaxies
• The Ĝ Infrared Search for Extraterrestrial Civilizations with Large Energy Supplies. II. Framework, Strategy, and First Result
• Astronomaly: Personalised Active Anomaly Detection in Astronomical Data
• The Breakthrough Listen Search for Intelligent Life: Public Data, Formats, Reduction and Archiving
• The Breakthrough Listen Search For Intelligent Life Near the Galactic Center I
• A deep-learning search for technosignatures of 820 nearby stars
• A Search for Technosignatures Around 31 Sun-like Stars with the Green Bank Telescope at 1.15-1.73 GHz
• Learning to detect RFI in radio astronomy without seeing it
• The Breakthrough Listen Search for Intelligent Life: Technosignature Search of 97 Nearby Galaxies
• The Breakthrough Listen Search for Intelligent Life: Searching for Technosignatures in Observations of TESS Targets of Interest
• Searching for broadband pulsed beacons from 1883 stars using neural networks
• Predicting Swarm Equatorial Plasma Bubbles via Machine Learning and Shapley Values
• A Machine-Learning-Based Direction-of-Origin Filter for the Identification of Radio Frequency Interference in the Search for Technosignatures
• Project Hephaistos - II. Dyson sphere candidates from Gaia DR3, 2MASS, and WISE
• Astronomaly at scale: searching for anomalies amongst 4 million galaxies
• The Breakthrough Listen Search for Intelligent Life: Technosignature Search of Transiting TESS Targets of Interest
• Setigen: Simulating Radio Technosignatures for SETI
• The ROAD to discovery: machine learning-driven anomaly detection in radio astronomy spectrograms
• Classification of Multiwavelength Transients with Machine Learning
• A 4-8 GHz Galactic Center Search for Periodic Technosignatures
• Enabling the discovery of fast transients: A kilonova science module for the Fink broker
• On Detecting Interstellar Scintillation in Narrowband Radio SETI
• The Breakthrough Listen Search for Intelligent Life: A Laser Search Pipeline for the Automated Planet Finder
• Finding radio transients with anomaly detection and active learning based on volunteer classifications

Cited by in corpus (3)

• Breakthrough Listen: A Technosignature Search Around 27 Eclipsing Exoplanets Selected from the Transiting Exoplanet Survey Satellite Catalogue
• An Improved Machine Learning Approach for Radio Frequency Interference Mitigation in FAST-SETI Survey Archival Data
• Narrowband Radio Technosignature Search toward 3I/ATLAS with FAST