40 citations · 53 across the 10 of their papers we have counts for
10 papers
PROV-IO+: A Cross-Platform Provenance Framework for Scientific Data on HPC Systems
Runzhou Han, Mai Zheng, Suren Byna +8
Data provenance, or data lineage, describes the life cycle of data. In scientific workflows on HPC systems, scientists often seek diverse provenance (e.g., origins of data products…
A Comparison of HDF5, Zarr, and netCDF4 in Performing Common I/O Operations
Sriniket Ambatipudi, Suren Byna
Scientific data is often stored in files because of the simplicity they provide in managing, transferring, and sharing data. These files are typically structured in a specific arra…
Accelerating Parallel Write via Deeply Integrating Predictive Lossy Compression with HDF5
Sian Jin, Dingwen Tao, Houjun Tang +4
Lossy compression is one of the most efficient solutions to reduce storage overhead and improve I/O performance for HPC applications. However, existing parallel I/O libraries canno…
The LBNL Superfacility Project Report
Deborah Bard, Cory Snavely, Lisa Gerhardt +24
The Superfacility model is designed to leverage HPC for experimental science. It is more than simply a model of connected experiment, network, and HPC facilities; it encompasses th…
Data Storage for HEP Experiments in the Era of High-Performance Computing
Amit Bashyal, Peter Van Gemmeren, Saba Sehrish +3
As particle physics experiments push their limits on both the energy and the intensity frontiers, the amount and complexity of the produced data are also expected to increase accor…
Improving Prediction-Based Lossy Compression Dramatically via Ratio-Quality Modeling
Sian Jin, Sheng Di, Jiannan Tian +3
Error-bounded lossy compression is one of the most effective techniques for scientific data reduction. However, the traditional trial-and-error approach used to configure lossy com…