1 citations · 1 across the 3 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.CL2024★ 1 cited
PhoneLM:an Efficient and Capable Small Language Model Family through Principled Pre-training
Rongjie Yi, Xiang Li, Weikai Xie +6
The interest in developing small language models (SLM) for on-device deployment is fast growing. However, the existing SLM design hardly considers the device hardware characteristi…
cs.LG2024
FedRDMA: Communication-Efficient Cross-Silo Federated LLM via Chunked RDMA Transmission
Zeling Zhang, Dongqi Cai, Yiran Zhang +3
Communication overhead is a significant bottleneck in federated learning (FL), which has been exaggerated with the increasing size of AI models. In this paper, we propose FedRDMA,…