13 citations · 25 across the 10 of their papers we have counts for
4 papers · 1 filter
SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training
Jinda Jia, Cong Xie, Hanlin Lu +8
Recent years have witnessed a clear trend towards language models with an ever-increasing number of parameters, as well as the growing training overhead and memory usage. Distribut…
NeurLZ: An Online Neural Learning-Based Method to Enhance Scientific Lossy Compression
Wenqi Jia, Zhewen Hu, Youyuan Liu +10
Large-scale scientific simulations generate massive datasets, posing challenges for storage and I/O. Traditional lossy compression struggles to advance more in balancing compressio…
A High-Quality Workflow for Multi-Resolution Scientific Data Reduction and Visualization
Daoce Wang, Pascal Grosset, Jesus Pulido +8
Multi-resolution methods such as Adaptive Mesh Refinement (AMR) can enhance storage efficiency for HPC applications generating vast volumes of data. However, their applicability is…
A Survey on Error-Bounded Lossy Compression for Scientific Datasets
Sheng Di, Jinyang Liu, Kai Zhao +23
Error-bounded lossy compression has been effective in significantly reducing the data storage/transfer burden while preserving the reconstructed data fidelity very well. Many error…