The ASKAP/EMU Source Finding Data Challenge

Abstract

The Evolutionary Map of the Universe (EMU) is a proposed radio continuum survey of the Southern Hemisphere up to declination +30 deg., with the Australian Square Kilometre Array Pathfinder (ASKAP). EMU will use an automated source identification and measurement approach that is demonstrably optimal, to maximise the reliability, utility and robustness of the resulting radio source catalogues. As part of the process of achieving this aim, a "Data Challenge" has been conducted, providing international teams the opportunity to test a variety of source finders on a set of simulated images. The aim is to quantify the accuracy of existing automated source finding and measurement approaches, and to identify potential limitations. The Challenge attracted nine independent teams, who tested eleven different source finding tools. In addition, the Challenge initiators also tested the current ASKAPsoft source-finding tool to establish how it could benefit from incorporating successful features of the other tools. Here we present the results of the Data Challenge, identifying the successes and limitations for this broad variety of the current generation of radio source finding tools. As expected, most finders demonstrate completeness levels close to 100% at 10sigma dropping to levels around 10% by 5sigma. The reliability is typically close to 100% at 10sigma, with performance to lower sensitivities varying greatly between finders. All finders demonstrate the usual trade-off between completeness and reliability, whereby maintaining a high completeness at low signal-to-noise comes at the expense of reduced reliability, and vice-versa. We conclude with a series of recommendations for improving the performance of the ASKAPsoft source-finding tool.

Accepted for publication in PASA. 27 pages, 10 figures, 5 tables

References in corpus (23)

• Astrophysics Source Code Library
• Hi-GAL: the Herschel infrared Galactic Plane Survey
• EMU: Evolutionary Map of the Universe
• Point Source Extraction with MOPEX
• Science With The Australian Square Kilometre Array Pathfinder
• The Arcminute Microkelvin Imager
• Compact continuum source-finding for next generation radio surveys
• Deep ATLAS radio observations of the CDFS-SWIRE field
• Source extraction and photometry for the far-infrared and sub-millimeter continuum in the presence of complex backgrounds
• BLOBCAT: Software to Catalogue Flood-Filled Blobs in Radio Images of Total Intensity and Linear Polarization
• Duchamp: a 3D source finder for spectral-line data
• The Mexican Hat Wavelet Family. Application to point source detection in CMB maps
• Source-finding for the Australian Square Kilometre Array Pathfinder
• Comparison of filters for the detection of point sources in Planck simulations
• HerMES: Point source catalogues from Herschel-SPIRE observations II
• Sensitive Search For Radio Variables And Transients In The Extended Chandra Deep-Field South
• 10C Survey of Radio Sources at 15.7 GHz: I - Observing, mapping and source extraction
• ATLAS 1.4 GHz Data Release 2 -- I. Observations of the CDF-S and ELAIS-S1 fields and methods for constructing differential number counts
• ATLAS 1.4 GHz Data Release 2 -- II. Properties of the faint polarized sky
• Comparison of potential ASKAP HI survey source finders
• The completeness and reliability of threshold and false-discovery-rate source extraction algorithms for compact continuum sources
• Feature Detection in Radio Astronomy using the Circle Hough Transform
• Biparametric Adaptive Filter: detection of compact sources in complex microwave backgrounds

Cited by in corpus (34)

• The GMRT 150 MHz All-sky Radio Survey: First Alternative Data Release TGSS ADR1
• Revisiting the Fanaroff-Riley dichotomy and radio-galaxy morphology with the LOFAR Two-Metre Sky Survey (LoTSS)
• Source finding in the era of the SKA (precursors): Aegean 2.0
• Radio Galaxy Zoo: Compact and extended radio source classification with deep learning
• Discovering the Unexpected in Astronomical Survey Data
• Square Kilometre Array Science Data Challenge 1: analysis and results
• DeepSource: Point Source Detection using Deep Learning
• The FIRST Classifier: Compact and Extended Radio Galaxy Classification using Deep Convolutional Neural Networks
• A VLA Search for Radio Signals from M31 and M33
• Detailed study of ELAIS N1 field with the uGMRT -- II. Source Properties and Spectral Variation Of Foreground Power Spectrum from 300-500 MHz Observations
• Radio Source Extraction with ProFound
• Deep 3 GHz Observations of the Lockman Hole North with the Very Large Array - 1. Source extraction and uncertainty analysis
• A High Reliability Survey of Discrete Epoch of Reionization Foreground Sources in the MWA EoR0 Field
• Morphological classification of compact and extended radio galaxies using convolutional neural networks and data augmentation techniques
• High-resolution VLA Imaging of Obscured Quasars: Young Radio Jets Caught in a Dense ISM
• Automated detection of extended sources in radio maps: progress from the SCORPIO survey
• PySE: Software for Extracting Sources from Radio Images
• Radio astronomical images object detection and segmentation: A benchmark on deep learning methods
• A closer look at the deep radio sky: Multi-component radio sources at 3-GHz VLA-COSMOS
• Continuum source catalog for the first APERTIF data release
• Machine Learning applied to Multifrequency Data in Astrophysics: Blazar Classification
• Evolutionary Map of the Universe (EMU):Compact radio sources in the SCORPIO field towards the Galactic plane
• Multi-band Optical and Near-infrared Properties of Faint Submillimeter Galaxies with Serendipitous ALMA Detections
• Challenging interferometric imaging: Machine learning-based source localization from uv-plane observations
• Radio Continuum Sources behind the Large Magellanic Cloud
• Selection of powerful radio galaxies with machine learning
• Data challenges as a tool for time-domain astronomy
• Central radio galaxies in galaxy clusters: Joint surveys by eROSITA and ASKAP
• Hydra I: An extensible multi-source-finder comparison and cataloguing tool
• Point Source Detection with Fully-Convolutional Networks: Performance in Realistic Simulations
• Astroinformatics Challenges from Next-generation Radio Continuum Surveys
• Point Proposal Network: Accelerating Point Source Detection Through Deep Learning
• Primary Beam Calibration for Commensal Telescopes Utilizing Offset Optics
• SPARKESX: Single-dish PARKES data sets for finding the uneXpected -- A data challenge