13 citations · 15 across the 5 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.DC2024
LR-CNN: Lightweight Row-centric Convolutional Neural Network Training for Memory Reduction
Zhigang Wang, Hangyu Yang, Ning Wang +5
In the last decade, Convolutional Neural Network with a multi-layer architecture has advanced rapidly. However, training its complex network is very space-consuming, since a lot of…
cs.DC2024
Accelerating Heterogeneous Tensor Parallelism via Flexible Workload Control
Zhigang Wang, Xu Zhang, Ning Wang +5
Transformer-based models are becoming deeper and larger recently. For better scalability, an underlying training solution in industry is to split billions of parameters (tensors) i…