7 papers
Deep Investigation of Neutral Gas Origins (DINGO): Options for the Processing and Storage of Radio Astronomy Data for robust Deep Spectral Line Imaging in the SKA-Era using uv-Grids
Alexander Williamson, Richard Dodson, Pascal J. Elahi +10
The next generation of radio astronomy telescopes are challenging existing data analysis paradigms, as they have an order of magnitude more antennas and larger bandwidth. Foremost…
JANUS: Resilient and Adaptive Data Transmission for Enabling Timely and Efficient Cross-Facility Scientific Workflows
Vladislav Esaulov, Jieyang Chen, Norbert Podhorszki +4
In modern science, the growing complexity of large-scale scientific projects has led to an increasing reliance on cross-facility scientific workflows, where resources and expertise…
HP-MDR: High-performance and Portable Data Refactoring and Progressive Retrieval with Advanced GPUs
Yanliang Li, Wenbo Li, Qian Gong +5
Scientific applications produce vast amounts of data, posing grand challenges in the underlying data management and analytic tasks. Progressive compression is a promising way to ad…
Optimising the Processing and Storage of Visibilities using lossy compression
Richard Dodson, Alex Williamson, Qian Gong +7
The next-generation radio astronomy instruments are providing a massive increase in sensitivity and coverage, through increased stations in the array and frequency span. Two primar…
HPDR: High-Performance Portable Scientific Data Reduction Framework
Jieyang Chen, Qian Gong, Yanliang Li +5
The rapid growth of scientific data is surpassing advancements in computing, creating challenges in storage, transfer, and analysis, particularly at the exascale. While data reduct…
A General Framework for Error-controlled Unstructured Scientific Data Compression
Qian Gong, Zhe Wang, Viktor Reshniak +10
Data compression plays a key role in reducing storage and I/O costs. Traditional lossy methods primarily target data on rectilinear grids and cannot leverage the spatial coherence…