Communication-Semantic-Aware RDMA Loss Recovery for QP-scalable Hyperscale AI Training

Xiaoxiang Hua, Tong Zhang, Zhenjiang Dong +3

Current artificial intelligence (AI) infrastructures widely adopt Remote Direct Memory Access (RDMA) to support high-performance communication. Training trillion-parameter models i…