DYNAMIX: RL-based Adaptive Batch Size Optimization in Distributed Machine Learning Systems

Yuanjun Dai, Keqiang He, An Wang

Existing batch size selection approaches in distributed machine learning rely on static allocation or simplistic heuristics that fail to adapt to heterogeneous, dynamic computing e…