6 citations · 12 across the 12 of their papers we have counts for
12 papers
V-ABFT: Variance-Based Adaptive Threshold for Fault-Tolerant Matrix Multiplication in Mixed-Precision Deep Learning
Yiheng Gao, Qin Hua, Zizhong Chen
Algorithm-Based Fault Tolerance (ABFT) is widely adopted to detect silent data corruptions (SDCs) in matrix multiplication, a cornerstone operation in deep learning systems. Howeve…
Boosting Scientific Error-Bounded Lossy Compression through Optimized Synergistic Lossy-Lossless Orchestration
Shixun Wu, Jinwen Pan, Jinyang Liu +8
As high-performance computing architectures evolve, more scientific computing workflows are being deployed on advanced computing platforms such as GPUs. These workflows can produce…
TurboFNO: High-Performance Fourier Neural Operator with Fused FFT-GEMM-iFFT on GPU
Shixun Wu, Yujia Zhai, Huangliang Dai +4
Fourier Neural Operators (FNO) are widely used for learning partial differential equation solution operators. However, FNO lacks architecture-aware optimizations,with its Fourier l…
FT-Transformer: Resilient and Reliable Transformer with End-to-End Fault Tolerant Attention
Huangliang Dai, Shixun Wu, Jiajun Huang +4
Transformer models rely on High-Performance Computing (HPC) resources for inference, where soft errors are inevitable in large-scale systems, making the reliability of the model pa…
ZCCL: Significantly Improving Collective Communication With Error-Bounded Lossy Compression
Jiajun Huang, Sheng Di, Xiaodong Yu +12
With the ever-increasing computing power of supercomputers and the growing scale of scientific applications, the efficiency of MPI collective communication turns out to be a critic…
TurboFFT: Co-Designed High-Performance and Fault-Tolerant Fast Fourier Transform on GPUs
Shixun Wu, Yujia Zhai, Jinyang Liu +6
GPU-based fast Fourier transform (FFT) is extremely important for scientific computing and signal processing. However, we find the inefficiency of existing FFT libraries and the ab…
DGRO: Diameter-Guided Ring Optimization for Integrated Research Infrastructure Membership
Shixun Wu, Krishnan Raghavan, Sheng Di +2
Logical ring is a core component in membership protocol. However, the logic ring fails to consider the underlying physical latency, resulting in a high diameter. To address this is…
FT K-means: A High-Performance K-means on GPU with Fault Tolerance
Shixun Wu, Yitong Ding, Yujia Zhai +8
K-means is a widely used algorithm in clustering, however, its efficiency is primarily constrained by the computational cost of distance computing. Existing implementations suffer…
TurboFFT: A High-Performance Fast Fourier Transform with Fault Tolerance on GPU
Shixun Wu, Yujia Zhai, Jinyang Liu +6
The Fast Fourier Transform (FFT), as a core computation in a wide range of scientific applications, is increasingly threatened by reliability issues. In this paper, we introduce Tu…
cuSZ-: High-Ratio Scientific Lossy Compression on GPUs with Optimized Multi-Level Interpolation
Jinyang Liu, Jiannan Tian, Shixun Wu +10
Error-bounded lossy compression is a critical technique for significantly reducing scientific data volumes. Compared to CPU-based compressors, GPU-based compressors exhibit substan…
High-performance Effective Scientific Error-bounded Lossy Compression with Auto-tuned Multi-component Interpolation
Jinyang Liu, Sheng Di, Kai Zhao +7
Error-bounded lossy compression has been identified as a promising solution for significantly reducing scientific data volumes upon users' requirements on data distortion. For the…
SRN-SZ: Deep Leaning-Based Scientific Error-bounded Lossy Compression with Super-resolution Neural Networks
Jinyang Liu, Sheng Di, Sian Jin +4
The fast growth of computational power and scales of modern super-computing systems have raised great challenges for the management of exascale scientific data. To maintain the usa…