296 citations · 963 across the 52 of their papers we have counts for
35 papers · 1 filter
LCP: Enhancing Scientific Data Management with Lossy Compression for Particles
Longtao Zhang, Ruoyu Li, Congrong Ren +10
Many scientific applications opt for particles instead of meshes as their basic primitives to model complex systems composed of billions of discrete entities. Such applications spa…
GWLZ: A Group-wise Learning-based Lossy Compression Framework for Scientific Data
Wenqi Jia, Sian Jin, Jinzhen Wang +3
The rapid expansion of computational capabilities and the ever-growing scale of modern HPC systems present formidable challenges in managing exascale scientific data. Faced with su…
A Survey on Error-Bounded Lossy Compression for Scientific Datasets
Sheng Di, Jinyang Liu, Kai Zhao +23
Error-bounded lossy compression has been effective in significantly reducing the data storage/transfer burden while preserving the reconstructed data fidelity very well. Many error…
cuSZ-: High-Ratio Scientific Lossy Compression on GPUs with Optimized Multi-Level Interpolation
Jinyang Liu, Jiannan Tian, Shixun Wu +10
Error-bounded lossy compression is a critical technique for significantly reducing scientific data volumes. Compared to CPU-based compressors, GPU-based compressors exhibit substan…
Analyzing Impact of Data Reduction Techniques on Visualization for AMR Applications Using AMReX Framework
Daoce Wang, Jesus Pulido, Pascal Grosset +3
Today's scientific simulations generate exceptionally large volumes of data, challenging the capacities of available I/O bandwidth and storage space. This necessitates a substantia…
AMRIC: A Novel In Situ Lossy Compression Framework for Efficient I/O in Adaptive Mesh Refinement Applications
Daoce Wang, Jesus Pulido, Pascal Grosset +11
As supercomputers advance towards exascale capabilities, computational intensity increases significantly, and the volume of data requiring storage and transmission experiences expo…
HEAT: A Highly Efficient and Affordable Training System for Collaborative Filtering Based Recommendation on CPUs
Chengming Zhang, Shaden Smith, Baixi Sun +6
Collaborative filtering (CF) has been proven to be one of the most effective techniques for recommendation. Among all CF approaches, SimpleX is the state-of-the-art method that ado…
FZ-GPU: A Fast and High-Ratio Lossy Compressor for Scientific Computing Applications on GPUs
Boyuan Zhang, Jiannan Tian, Sheng Di +5
Today's large-scale scientific applications running on high-performance computing (HPC) systems generate vast data volumes. Thus, data compression is becoming a critical technique…
GPULZ: Optimizing LZSS Lossless Compression for Multi-byte Data on Modern GPUs
Boyuan Zhang, Jiannan Tian, Sheng Di +4
Today's graphics processing unit (GPU) applications produce vast volumes of data, which are challenging to store and transfer efficiently. Thus, data compression is becoming a crit…
TAC+: Optimizing Error-Bounded Lossy Compression for 3D AMR Simulations
Daoce Wang, Jesus Pulido, Pascal Grosset +5
Today's scientific simulations require significant data volume reduction because of the enormous amounts of data produced and the limited I/O bandwidth and storage space. Error-bou…
SOLAR: A Highly Optimized Data Loading Framework for Distributed Training of CNN-based Scientific Surrogates
Baixi Sun, Xiaodong Yu, Chengming Zhang +7
CNN-based surrogates have become prevalent in scientific applications to replace conventional time-consuming physical approaches. Although these surrogates can yield satisfactory r…
TDC: Towards Extremely Efficient CNNs on GPUs via Hardware-Aware Tucker Decomposition
Lizhi Xiang, Miao Yin, Chengming Zhang +4
Tucker decomposition is one of the SOTA CNN model compression techniques. However, unlike the FLOPs reduction, we observe very limited inference time reduction with Tucker-compress…
HBMax: Optimizing Memory Efficiency for Parallel Influence Maximization on Multicore Architectures
Xinyu Chen, Marco Minutoli, Jiannan Tian +3
Influence maximization aims to select k most-influential vertices or seeds in a network, where influence is defined by a given diffusion process. Although computing optimal seed se…
Accelerating Parallel Write via Deeply Integrating Predictive Lossy Compression with HDF5
Sian Jin, Dingwen Tao, Houjun Tang +4
Lossy compression is one of the most efficient solutions to reduce storage overhead and improve I/O performance for HPC applications. However, existing parallel I/O libraries canno…
TAC: Optimizing Error-Bounded Lossy Compression for Three-Dimensional Adaptive Mesh Refinement Simulations
Daoce Wang, Jesus Pulido, Pascal Grosset +4
Today's scientific simulations require a significant reduction of data volume because of extremely large amounts of data they produce and the limited I/O bandwidth and storage spac…
SZx: an Ultra-fast Error-bounded Lossy Compressor for Scientific Datasets
Xiaodong Yu, Sheng Di, Kai Zhao +4
Today's scientific high performance computing (HPC) applications or advanced instruments are producing vast volumes of data across a wide range of domains, which introduces a serio…
SIMD Lossy Compression for Scientific Data
Griffin Dube, Jiannan Tian, Sheng Di +3
Modern HPC applications produce increasingly large amounts of data, which limits the performance of current extreme-scale systems. Data reduction techniques, such as lossy compress…
Optimizing Huffman Decoding for Error-Bounded Lossy Compression on GPUs
Cody Rivera, Sheng Di, Jiannan Tian +3
More and more HPC applications require fast and effective compression techniques to handle large volumes of data in storage and transmission. Not only do these applications need to…
SZ3: A Modular Framework for Composing Prediction-Based Error-Bounded Lossy Compressors
Xin Liang, Kai Zhao, Sheng Di +9
Today's scientific simulations require a significant reduction of data volume because of extremely large amounts of data they produce and the limited I/O bandwidth and storage spac…
CEAZ: Accelerating Parallel I/O via Hardware-Algorithm Co-Designed Adaptive Lossy Compression
Chengming Zhang, Sian Jin, Tong Geng +3
As HPC systems continue to grow to exascale, the amount of data that needs to be saved or transmitted is exploding. To this end, many previous works have studied using error-bounde…
Characterizing Impacts of Storage Faults on HPC Applications: A Methodology and Insights
Bo Fang, Daoce Wang, Sian Jin +6
In recent years, the increasing complexity in scientific simulations and emerging demands for training heavy artificial intelligence models require massive and fast data accesses,…
Optimizing Error-Bounded Lossy Compression for Scientific Data on GPUs
Jiannan Tian, Sheng Di, Xiaodong Yu +7
Error-bounded lossy compression is a critical technique for significantly reducing scientific data volumes. With ever-emerging heterogeneous high-performance computing (HPC) archit…
Adaptive Configuration of In Situ Lossy Compression for Cosmology Simulations via Fine-Grained Rate-Quality Modeling
Sian Jin, Jesus Pulido, Pascal Grosset +3
Extreme-scale cosmological simulations have been widely used by today's researchers and scientists on leadership supercomputers. A new generation of error-bounded lossy compressors…
SDRBench: Scientific Data Reduction Benchmark for Lossy Compressors
Kai Zhao, Sheng Di, Xin Liang +5
Efficient error-controlled lossy compressors are becoming critical to the success of today's large-scale scientific applications because of the ever-increasing volume of data produ…