activity
20242026
most citedSTZ: A High Quality and High Speed Streaming Lossy Compression Framework for Scientific Data

1 citations · 1 across the 3 of their papers we have counts for

collaborators
Showing 2024Show all

1 paper · 1 filter

cs.LG2024

SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training

Jinda Jia, Cong Xie, Hanlin Lu +8

Recent years have witnessed a clear trend towards language models with an ever-increasing number of parameters, as well as the growing training overhead and memory usage. Distribut…