3 papers
cs.LG2024
Ordered Momentum for Asynchronous SGD
Chang-Wei Shi, Yi-Rui Yang, Wu-Jun Li
Distributed learning is essential for training large-scale deep models. Asynchronous SGD (ASGD) and its variants are commonly used distributed learning methods, particularly in sce…
cs.CR2024
Buffered Asynchronous Secure Aggregation for Cross-Device Federated Learning
Kun Wang, Yi-Rui Yang, Wu-Jun Li
Asynchronous federated learning (AFL) is an effective method to address the challenge of device heterogeneity in cross-device federated learning. However, AFL is usually incompatib…
cs.LG2023
On the Optimal Batch Size for Byzantine-Robust Distributed Learning
Yi-Rui Yang, Chang-Wei Shi, Wu-Jun Li
Byzantine-robust distributed learning (BRDL), in which computing devices are likely to behave abnormally due to accidental failures or malicious attacks, has recently become a hot…