6 papers
Scaling Synthetic-Image Pre-Training for Federated Fine-Tuning of Large Vision Models
Qianpiao Ma, Xiaozhu Song, Junlong Zhou +3
Federated fine-tuning (FedFT) enables adapting pre-trained large vision models (LVMs) on distributed, privacy-sensitive devices, while its practical deployment is hindered by three…
Towards Communication-Efficient Decentralized Federated Graph Learning over Non-IID Data
Shilong Wang, Jianchun Liu, Hongli Xu +3
Decentralized Federated Graph Learning (DFGL) overcomes potential bottlenecks of the parameter server in FGL by establishing a peer-to-peer (P2P) communication network among worker…
DySTop
Yizhou Shi, Qianpiao Ma, Yan Xu +4
Federated Learning (FL) has emerged as a potential distributed learning paradigm that enables model training on edge devices (i.e., workers) while preserving data privacy. However,…
Air-FedGA: A Grouping Asynchronous Federated Learning Mechanism Exploiting Over-the-air Computation
Qianpiao Ma, Junlong Zhou, Xiangpeng Hou +4
Federated learning (FL) is a new paradigm to train AI models over distributed edge devices (i.e., workers) using their local data, while confronting various challenges including co…
FedQuad: Adaptive Layer-wise LoRA Deployment and Activation Quantization for Federated Fine-Tuning
Rukuo Li, Jianchun Liu, Hongli Xu +1
Federated fine-tuning (FedFT) provides an effective paradigm for fine-tuning large language models (LLMs) in privacy-sensitive scenarios. However, practical deployment remains chal…
Accelerating End-Cloud Collaborative Inference via Near Bubble-free Pipeline Optimization
Luyao Gao, Jianchun Liu, Hongli Xu +3
End-cloud collaboration offers a promising strategy to enhance the Quality of Service (QoS) in DNN inference by offloading portions of the inference workload from end devices to cl…