GBA: A Tuning-free Approach to Switch between Synchronous and Asynchronous Training for Recommendation Model

Wenbo Su, Yuanxing Zhang, Yufeng Cai +9

High-concurrency asynchronous training upon parameter server (PS) architecture and high-performance synchronous training upon all-reduce (AR) architecture are the most commonly dep…