296 citations · 660 across the 30 of their papers we have counts for
30 papers
Dynamic Quality Metric Oriented Error-bounded Lossy Compression for Scientific Datasets
Jinyang Liu, Sheng Di, Kai Zhao +3
With the ever-increasing execution scale of high performance computing (HPC) applications, vast amounts of data are being produced by scientific research every day. Error-bounded l…
gZCCL: Compression-Accelerated Collective Communication Framework for GPU Clusters
Jiajun Huang, Sheng Di, Xiaodong Yu +11
GPU-aware collective communication has become a major bottleneck for modern computing platforms as GPU computing power rapidly rises. A traditional approach is to directly integrat…
Accelerating MPI Collectives with Process-in-Process-based Multi-object Techniques
Jiajun Huang, Kaiming Ouyang, Yujia Zhai +8
In the exascale computing era, optimizing MPI collective performance in high-performance computing (HPC) applications is critical. Current algorithms face performance degradation d…
FT-GEMM: A Fault Tolerant High Performance GEMM Implementation on x86 CPUs
Shixun Wu, Yujia Zhai, Jiajun Huang +2
General matrix/matrix multiplication (GEMM) is crucial for scientific computing and machine learning. However, the increased scale of the computing platforms raises concerns about…
Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs
Shixun Wu, Yujia Zhai, Jinyang Liu +4
General Matrix Multiplication (GEMM) is a crucial algorithm for various applications such as machine learning and scientific computing, and an efficient GEMM implementation is esse…
An Optimized Error-controlled MPI Collective Framework Integrated with Lossy Compression
Jiajun Huang, Sheng Di, Xiaodong Yu +11
With the ever-increasing computing power of supercomputers and the growing scale of scientific applications, the efficiency of MPI collective communications turns out to be a criti…
Improving Energy Saving of One-sided Matrix Decompositions on CPU-GPU Heterogeneous Systems
Jieyang Chen, Xin Liang, Kai Zhao +3
One-sided dense matrix decompositions (e.g., Cholesky, LU, and QR) are the key components in scientific computing in many different fields. Although their design has been highly op…
ByteTransformer: A High-Performance Transformer Boosted for Variable-Length Inputs
Yujia Zhai, Chengquan Jiang, Leyuan Wang +5
Transformers have become keystone models in natural language processing over the past decade. They have achieved great popularity in deep learning applications, but the increasing…
Multi-granularity Association Learning Framework for on-the-fly Fine-Grained Sketch-based Image Retrieval
Dawei Dai, Xiaoyu Tang, Shuyin Xia +3
Fine-grained sketch-based image retrieval (FG-SBIR) addresses the problem of retrieving a particular photo in a given query sketch. However, its widespread applicability is limited…
A Unified Granular-ball Learning Model of Pawlak Rough Set and Neighborhood Rough Set
Shuyin Xia, Cheng Wang, Guoyin Wang +5
Pawlak rough set and neighborhood rough set are the two most common rough set theoretical models. Pawlak can use equivalence classes to represent knowledge, but it cannot process c…
SZ3: A Modular Framework for Composing Prediction-Based Error-Bounded Lossy Compressors
Xin Liang, Kai Zhao, Sheng Di +9
Today's scientific simulations require a significant reduction of data volume because of extremely large amounts of data they produce and the limited I/O bandwidth and storage spac…
Accelerating Encrypted Computing on Intel GPUs
Yujia Zhai, Mohannad Ibrahim, Yiqin Qiu +4
Homomorphic Encryption (HE) is an emerging encryption scheme that allows computations to be performed directly on encrypted messages. This property provides promising applications…
Exploring Autoencoder-based Error-bounded Compression for Scientific Data
Jinyang Liu, Sheng Di, Kai Zhao +5
Error-bounded lossy compression is becoming an indispensable technique for the success of today's scientific projects with vast volumes of data produced during simulations or instr…
FT-BLAS: A High Performance BLAS Implementation With Online Fault Tolerance
Yujia Zhai, Elisabeth Giem, Quan Fan +3
Basic Linear Algebra Subprograms (BLAS) is a core library in scientific computing and machine learning. This paper presents FT-BLAS, a new implementation of BLAS routines that not…
Efficient Soft-Error Detection for Low-precision Deep Learning Recommendation Models
Sihuan Li, Jianyu Huang, Ping Tak Peter Tang +4
Soft error, namely silent corruption of signal or datum in a computer system, cannot be caverlierly ignored as compute and communication density grow exponentially. Soft error dete…
SDRBench: Scientific Data Reduction Benchmark for Lossy Compressors
Kai Zhao, Sheng Di, Xin Liang +5
Efficient error-controlled lossy compressors are becoming critical to the success of today's large-scale scientific applications because of the ever-increasing volume of data produ…
SDC Resilient Error-bounded Lossy Compressor
Sihuan Li, Sheng Di, Kai Zhao +3
Lossy compression is one of the most important strategies to resolve the big science data issue, however, little work was done to make it resilient against silent data corruptions…
Ball k-means
Shuyin Xia, Daowan Peng, Deyu Meng +4
This paper presents a novel accelerated exact k-means algorithm called the Ball k-means algorithm, which uses a ball to describe a cluster, focusing on reducing the point-centroid…
FT-CNN: Algorithm-Based Fault Tolerance for Convolutional Neural Networks
Kai Zhao, Sheng Di, Sihuan Li +6
Convolutional neural networks (CNNs) are becoming more and more important for solving challenging and critical problems in many fields. CNN inference applications have been deploye…
Normalization of Input-output Shared Embeddings in Text Generation Models
Jinyang Liu, Yujia Zhai, Zizhong Chen
Neural Network based models have been state-of-the-art models for various Natural Language Processing tasks, however, the input and output dimension problem in the networks has sti…
Optimizing Lossy Compression Rate-Distortion from Automatic Online Selection between SZ and ZFP
Dingwen Tao, Sheng Di, Xin Liang +2
With ever-increasing volumes of scientific data produced by HPC applications, significantly reducing data size is critical because of limited capacity of storage space and potentia…
Improving Performance of Iterative Methods by Lossy Checkponting
Dingwen Tao, Sheng Di, Xin Liang +2
Iterative methods are commonly used approaches to solve large, sparse linear systems, which are fundamental operations for many modern scientific simulations. When the large-scale…
Fixed-PSNR Lossy Compression for Scientific Data
Dingwen Tao, Sheng Di, Xin Liang +2
Error-controlled lossy compression has been studied for years because of extremely large volumes of data being produced by today's scientific simulations. None of existing lossy co…
Build and Execution Environment (BEE): an Encapsulated Environment Enabling HPC Applications Running Everywhere
Jieyang Chen, Qiang Guan, Xin Liang +5
Variations in High Performance Computing (HPC) system software configurations mean that applications are typically configured and built for specific HPC environments. Building appl…