40 citations · 53 across the 10 of their papers we have counts for
6 papers · 1 filter
PROV-IO+: A Cross-Platform Provenance Framework for Scientific Data on HPC Systems
Runzhou Han, Mai Zheng, Suren Byna +8
Data provenance, or data lineage, describes the life cycle of data. In scientific workflows on HPC systems, scientists often seek diverse provenance (e.g., origins of data products…
A Comparison of HDF5, Zarr, and netCDF4 in Performing Common I/O Operations
Sriniket Ambatipudi, Suren Byna
Scientific data is often stored in files because of the simplicity they provide in managing, transferring, and sharing data. These files are typically structured in a specific arra…
Accelerating Parallel Write via Deeply Integrating Predictive Lossy Compression with HDF5
Sian Jin, Dingwen Tao, Houjun Tang +4
Lossy compression is one of the most efficient solutions to reduce storage overhead and improve I/O performance for HPC applications. However, existing parallel I/O libraries canno…
The LBNL Superfacility Project Report
Deborah Bard, Cory Snavely, Lisa Gerhardt +24
The Superfacility model is designed to leverage HPC for experimental science. It is more than simply a model of connected experiment, network, and HPC facilities; it encompasses th…
Characterizing Impacts of Storage Faults on HPC Applications: A Methodology and Insights
Bo Fang, Daoce Wang, Sian Jin +6
In recent years, the increasing complexity in scientific simulations and emerging demands for training heavy artificial intelligence models require massive and fast data accesses,…
PANDA: Extreme Scale Parallel K-Nearest Neighbor on Distributed Architectures
Md. Mostofa Ali Patwary, Nadathur Rajagopalan Satish, Narayanan Sundaram +8
Computing -Nearest Neighbors (KNN) is one of the core kernels used in many machine learning, data mining and scientific computing applications. Although kd-tree based $O(\log n)…