2 papers
cs.CV2024
Faster Multi-GPU Training with PPLL: A Pipeline Parallelism Framework Leveraging Local Learning
Xiuyuan Guo, Chengqi Xu, Guinan Guo +6
Currently, training large-scale deep learning models is typically achieved through parallel training across multiple GPUs. However, due to the inherent communication overhead and s…
cs.CV2024
Advancing Supervised Local Learning Beyond Classification with Long-term Feature Bank
Feiyu Zhu, Yuming Zhang, Xiuyuan Guo +4
Local learning offers an alternative to traditional end-to-end back-propagation in deep neural networks, significantly reducing GPU memory consumption. Although it has shown promis…