2 citations · 4 across the 4 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.DB2023★ 2 cited
RINAS: Training with Dataset Shuffling Can Be General and Fast
Tianle Zhong, Jiechen Zhao, Xindi Guo +2
Deep learning datasets are expanding at an unprecedented pace, creating new challenges for data processing in model training pipelines. A crucial aspect of these pipelines is datas…
cs.DC2023★ 2 cited
RTP: Rethinking Tensor Parallelism with Memory Deduplication
Cheng Luo, Tianle Zhong, Geoffrey Fox
In the evolving landscape of neural network models, one prominent challenge stand out: the significant memory overheads associated with training expansive models. Addressing this c…