A Fast, Performant, Secure Distributed Training Framework For Large Language Model

Wei Huang, Yinggui Wang, Anda Cheng +3

The distributed (federated) LLM is an important method for co-training the domain-specific LLM using siloed data. However, maliciously stealing model parameters and data from the s…