Hybrid Dual-Batch and Cyclic Progressive Learning for Efficient Distributed Training

Kuan-Wei Lu, Ding-Yong Hong, Pangfeng Liu +1

Distributed machine learning is critical for training deep learning models on large datasets with numerous parameters. Current research primarily focuses on leveraging additional h…