6 citations · 16 across the 26 of their papers we have counts for
18 papers · 1 filter
LOCAA: An Agentic System for Automated Lossy Compressor Tuning
Khondoker Mirazul Mumenin, Dong Dai, Sheng Di +2
Large-scale scientific simulations generate substantial data volumes, making lossy compression essential for reducing storage and data movement costs. However, users configure comp…
ReCoVer: Resilient LLM Pre-Training System via Fault-Tolerant Collective and Versatile Workload
Ziyue Liu, Zhengyang Wang, Ruijie Zhang +7
Pre-training large language models on massive GPU clusters has made hardware faults routine rather than rare, driving the need for resilient training systems. Yet existing framewor…
SPARe: Stacked Parallelism with Adaptive Reordering for Fault-Tolerant LLM Pretraining Systems with 100k+ GPUs
Jin Lee, Zhonghao Chen, Xuhang He +6
In large-scale LLM pre-training systems with 100k+ GPUs, failures become the norm rather than the exception, and restart costs can dominate wall-clock training time. However, exist…
Mitigating Artifacts in Pre-quantization Based Scientific Data Compressors with Quantization-aware Interpolation
Pu Jiao, Sheng Di, Jiannan Tian +5
Error-bounded lossy compression has been regarded as a promising way to address the ever-increasing amount of scientific data in today's high-performance computing systems. Pre-qua…
TopoSZp: Lightweight Topology-Aware Error-controlled Compression for Scientific Data
Tripti Agarwal, Sheng Di, Xin Liang +5
Error-bounded lossy compression is essential for managing the massive data volumes produced by large-scale HPC simulations. While state-of-the-art compressors such as SZ and ZFP pr…
pMSz: A Distributed Parallel Algorithm for Correcting Extrema and Morse Smale Segmentations in Lossy Compression
Yuxiao Li, Mingze Xia, Xin Liang +7
Lossy compression, widely used by scientists to reduce data from simulations, experiments, and observations, can distort features of interest even under bounded error. Such distort…
FFCz: Fast Fourier Correction for Spectrum-Preserving Lossy Compression of Scientific Data
Congrong Ren, Robert Underwood, Sheng Di +5
This paper introduces a novel technique to preserve spectral features in lossy compression based on a novel fast Fourier correction algorithm\added{ for regular-grid data}. Preserv…
Boosting Scientific Error-Bounded Lossy Compression through Optimized Synergistic Lossy-Lossless Orchestration
Shixun Wu, Jinwen Pan, Jinyang Liu +8
As high-performance computing architectures evolve, more scientific computing workflows are being deployed on advanced computing platforms such as GPUs. These workflows can produce…
GPZ: GPU-Accelerated Lossy Compressor for Particle Data
Ruoyu Li, Yafan Huang, Longtao Zhang +10
Particle-based simulations and point-cloud applications generate massive, irregular datasets that challenge storage, I/O, and real-time analytics. Traditional compression technique…
IPComp: Interpolation Based Progressive Lossy Compression for Scientific Applications
Zhuoxun Yang, Sheng Di, Longtao Zhang +6
Compression is a crucial solution for data reduction in modern scientific applications due to the exponential growth of data from simulations, experiments, and observations. Compre…
ZCCL: Significantly Improving Collective Communication With Error-Bounded Lossy Compression
Jiajun Huang, Sheng Di, Xiaodong Yu +12
With the ever-increasing computing power of supercomputers and the growing scale of scientific applications, the efficiency of MPI collective communication turns out to be a critic…
TurboFFT: Co-Designed High-Performance and Fault-Tolerant Fast Fourier Transform on GPUs
Shixun Wu, Yujia Zhai, Jinyang Liu +6
GPU-based fast Fourier transform (FFT) is extremely important for scientific computing and signal processing. However, we find the inefficiency of existing FFT libraries and the ab…
DGRO: Diameter-Guided Ring Optimization for Integrated Research Infrastructure Membership
Shixun Wu, Krishnan Raghavan, Sheng Di +2
Logical ring is a core component in membership protocol. However, the logic ring fails to consider the underlying physical latency, resulting in a high diameter. To address this is…
To Compress or Not To Compress: Energy Trade-Offs and Benefits of Lossy Compressed I/O
Grant Wilkins, Sheng Di, Jon C. Calhoun +2
Modern scientific simulations generate massive volumes of data, creating significant challenges for I/O and storage systems. Error-bounded lossy compression (EBLC) offers a solutio…
HoSZp: An Efficient Homomorphic Error-bounded Lossy Compressor for Scientific Data
Tripti Agarwal, Sheng Di, Jiajun Huang +7
Error-bounded lossy compression has been a critical technique to significantly reduce the sheer amounts of simulation datasets for high-performance computing (HPC) scientific appli…
FT K-means: A High-Performance K-means on GPU with Fault Tolerance
Shixun Wu, Yitong Ding, Yujia Zhai +8
K-means is a widely used algorithm in clustering, however, its efficiency is primarily constrained by the computational cost of distance computing. Existing implementations suffer…
TurboFFT: A High-Performance Fast Fourier Transform with Fault Tolerance on GPU
Shixun Wu, Yujia Zhai, Jinyang Liu +6
The Fast Fourier Transform (FFT), as a core computation in a wide range of scientific applications, is increasingly threatened by reliability issues. In this paper, we introduce Tu…
A Survey on Error-Bounded Lossy Compression for Scientific Datasets
Sheng Di, Jinyang Liu, Kai Zhao +23
Error-bounded lossy compression has been effective in significantly reducing the data storage/transfer burden while preserving the reconstructed data fidelity very well. Many error…