40 citations · 53 across the 10 of their papers we have counts for
4 papers · 1 filter
A Comparison of HDF5, Zarr, and netCDF4 in Performing Common I/O Operations
Sriniket Ambatipudi, Suren Byna
Scientific data is often stored in files because of the simplicity they provide in managing, transferring, and sharing data. These files are typically structured in a specific arra…
Accelerating Parallel Write via Deeply Integrating Predictive Lossy Compression with HDF5
Sian Jin, Dingwen Tao, Houjun Tang +4
Lossy compression is one of the most efficient solutions to reduce storage overhead and improve I/O performance for HPC applications. However, existing parallel I/O libraries canno…
The LBNL Superfacility Project Report
Deborah Bard, Cory Snavely, Lisa Gerhardt +24
The Superfacility model is designed to leverage HPC for experimental science. It is more than simply a model of connected experiment, network, and HPC facilities; it encompasses th…
Data Storage for HEP Experiments in the Era of High-Performance Computing
Amit Bashyal, Peter Van Gemmeren, Saba Sehrish +3
As particle physics experiments push their limits on both the energy and the intensity frontiers, the amount and complexity of the produced data are also expected to increase accor…