Optimizing Distributed Training Approaches for Scaling Neural Networks

Vishnu Vardhan Baligodugula, Fathi Amsaad

This paper presents a comparative analysis of distributed training strategies for large-scale neural networks, focusing on data parallelism, model parallelism, and hybrid approache…