Rapid Development of Interferometric Software Using MIRIAD and Python

Abstract

New and upgraded radio interferometers produce data at massive rates and will require significant improvements in analysis techniques to reach their promised levels of performance in a routine manner. Until these techniques are fully developed, productivity and accessibility in scientific programming environments will be key bottlenecks in the pipeline leading from data-taking to research results. We present an open-source software package, miriad-python, that allows access to the MIRIAD interferometric reduction system in the Python programming language. The modular design of MIRIAD and the high productivity and accessibility of Python provide an excellent foundation for rapid development of interferometric software. Several other projects with similar goals exist and we describe them and compare miriad-python to them in detail. Along with an overview of the package design, we present sample code and applications, including the detection of millisecond astrophysical transients, determination and application of nonstandard calibration parameters, interactive data visualization, and a reduction pipeline using a directed acyclic graph dependency model analogous to that of the traditional Unix tool "make". The key aspects of the miriad-python software project are documented. We find that miriad-python provides an extremely effective environment for prototyping new interferometric software, though certain existing packages provide far more infrastructure for some applications. While equivalent software written in compiled languages can be much faster than Python, there are many situations in which execution time is profitably exchanged for speed of development, code readability, accessibility to nonexpert programmers, quick interlinking with foreign software packages, and other virtues of the Python language.

Submitted to PASP; 13 pages, 4 figures

References in corpus (22)

• HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
• The Submillimeter Array
• DSPSR: Digital Signal Processing Software for Pulsar Astronomy
• PyCUDA and PyOpenCL: A Scripting-Based Approach to GPU Run-Time Code Generation
• A multi-scale multi-frequency deconvolution algorithm for synthesis imaging in radio interferometry
• The Expanded Very Large Array -- a New Telescope for New Science
• The Precision Array for Probing the Epoch of Reionization: 8 Station Results
• The Murchison Widefield Array: Design Overview
• Science with the Square Kilometer Array: Motivation, Key Science Projects, Standards and Assumptions
• The non-coplanar baselines effect in radio interferometry: The W-Projection algorithm
• Revisiting the radio interferometer measurement equation. I. A full-sky Jones formalism
• Correcting direction-dependent gains in the deconvolution of radio interferometric images
• The Allen Telescope Array: The First Widefield, Panchromatic, Snapshot Radio Camera for Radio Astronomy and SETI
• Radio Interferometric Calibration Using The SAGE Algorithm
• The MeqTrees software system and its use for third-generation calibration of radio interferometers
• Calibration of Low-Frequency, Wide-Field Radio Interferometers Using Delay/Delay-Rate Filtering
• APERTIF, a focal plane array for the WSRT
• Visibility stacking in the quest for SNIa radio emission
• Real-time, fast radio transient searches with GPU de-dispersion
• Millisecond Imaging of Radio Transients with the Pocket Correlator
• Interactive Visualization of the Largest Radioastronomy Cubes
• Commensal observing with the Allen Telescope array: software command and control

Cited by in corpus (6)

• The EGNoG Survey: Molecular Gas in Intermediate-Redshift Star-Forming Galaxies
• The EGNoG Survey: Gas Excitation in Normal Galaxies at z~0.3
• ASGARD: A Large Survey for Slow Galactic Radio Transients. I. Overview and First Results
• GPU-Based High-Performance Imaging for Mingantu Spectral RadioHeliograph
• The disk-outflow system around the rare young O-type protostar W42-MME
• The RRAT Trap: Interferometric Localization of Radio Pulses from J0628+0909