On the completeness and reliability of visual source extraction : an examination of eight thousand data cubes by eye
arXiv:2503.07430 · doi:10.1051/0004-6361/202451606
Abstract
[Edited for arXiv] Source extraction in HI radio surveys is still often performed using visual inspection, but the efficacy of such procedures lacks rigorous quantitative assessment due to their laborious nature. Algorithmic methods are often preferred due to their repeatable results and speed. I here quantitatively assess visual source extraction using a large sample of artificial sources and a comparatively rapid source extraction tool, and compare the results with those from automatic techniques. I injected 4,232 sources into a total of 8,500 emission-free data cubes, with at most one source per cube. Sources covered a wide range of signal-to-noise and velocity widths. I blindly searched all cubes, measuring the completeness and reliability for pairs of signal-to-noise and line width values. Smaller control tests were performed to account for the possible biases in the search, which gave results in good agreement with the main experiment. I also searched cubes injected with artificial sources using algorithmic extractors, and compare these results with a set of catalogues independently reported from real observational data. I find that the results of visual extraction follow a tight relation between integrated signal-to-noise and completeness. Visual extraction compares favourably in efficacy with the algorithmic methods, tending to recover a higher fraction of fainter sources. Visual source extraction can be a surprisingly rapid procedure which gives higher completeness levels than automatic techniques, giving predictable, quantifiable results which are not strongly subject to the whims of the observer. For recovering the faintest features, algorithmic extractors can be competitive with visual inspection but cannot yet out-perform it, though their advantage in speed can be a significant compensating factor.
Accepted for publication in Astronomy and Astrophysics. 21 pages, 11 figures, 3 tables. Code and data needed to reproduce the experiments described are included in the "data availability" section
References in corpus (37)
- The Arecibo Legacy Fast ALFA Survey: I. Science Goals, Survey Design and Strategy
- The Arecibo Legacy Fast ALFA Survey: The alpha.40 HI Source Catalog, its Characteristics and their Impact on the Derivation of the HI Mass Function
- The HIPASS Catalogue - I. Data Presentation
- The Arecibo Legacy Fast ALFA Survey: The ALFALFA Extragalactic HI Source Catalog
- SoFiA: a flexible source finder for 3D spectral line data
- WALLABY -- An SKA Pathfinder HI Survey
- The HIPASS Catalogue: III - Optical Counterparts & Isolated Dark Galaxies
- The Northern HIPASS catalogue - Data presentation, completeness and reliability measures
- SoFiA 2 -- An automated, parallel HI source finding pipeline for the WALLABY survey
- The Arecibo Legacy Fast ALFA Survey: IV. Strategies for Signal Identification and Survey Catalog Reliability
- Duchamp: a 3D source finder for spectral-line data
- The HIPASS Catalogue - II. Completeness, Reliability, and Parameter Accuracy
- New Galaxies Discovered in the First Blind HI Survey of the Centaurus A Group
- The ALFALFA "Almost Darks" Campaign: Pilot VLA HI Observations of Five High Mass-to-Light Ratio Systems
- The FAST all sky HI survey (FASHI): The first release of catalog
- The Arecibo Galaxy Environment Survey: Precursor Observations of the NGC 628 group
- The Arecibo Dual-Beam Survey: Arecibo and VLA Observations
- The Parkes HI Zone of Avoidance Survey
- The Arecibo Galaxy Environment Survey V : The Virgo Cluster (I)
- The Arecibo Galaxy Environment Survey: II. A HI view of the Abell cluster 1367 and its outskirts
- A Deep Survey of HI-Selected Galaxies: The Sample and the Data
- Using negative detections to estimate source finder reliability
- HIDEEP - An extragalactic blind survey for very low column-density neutral hydrogen
- The Arecibo Galaxy Environment Survey VI : The Virgo Cluster (II)
- Comparison of potential ASKAP HI survey source finders
- Statistical Analysis of H I Profile Asymmetry and Shape for Nearby Galaxies
- The Arecibo Galaxy Environment Survey III: Observations Toward the Galaxy Pair NGC 7332/7339 and the Isolated Galaxy NGC 1156
- The Arecibo Ultra-Deep Survey
- SKA Science Data Challenge 2: analysis and results
- The ALFA ZOA Deep Survey: First Results
- Faint and fading tails : the fate of stripped HI gas in Virgo cluster galaxies
- Identifying OH Imposters in the ALFALFA Neutral Hydrogen Survey
- The Widefield Arecibo Virgo Extragalactic Survey I: New structures in the ALFALFA Virgo 7 cloud complex and an extended tail on NGC 4522
- The Arecibo Galaxy Environment Survey VII : A Dense Filament With Extremely Long HI Streams
- The Arecibo Galaxy Environment Survey XII : Optically dark HI clouds in the Leo I Group
- The Arecibo Galaxy Environment Survey (AGES) XI: the expanded Abell 1367 field. Data catalogue and HI census over the surveyed volume
- Sports stars: analyzing the performance of astronomers at visualization-based discovery