2 citations · 7 across the 23 of their papers we have counts for
9 papers · 1 filter
Breaking the Structural Identity: Personalized Federated LoRA Fine-tuning under Rank Heterogeneity
Lei Wang, Jieming Bian, Letian Zhang +1
Large Language Models (LLMs) have achieved remarkable success across diverse domains, but their adaptation to privacy-sensitive, distributed datasets remains a challenge. While Fed…
FedTreeLoRA: Reconciling Statistical and Functional Heterogeneity in Federated LoRA Fine-Tuning
Jieming Bian, Lei Wang, Letian Zhang +1
Federated Learning (FL) with Low-Rank Adaptation (LoRA) has become a standard for privacy-preserving LLM fine-tuning. However, existing personalized methods predominantly operated…
Adaptive LoRA Experts Allocation and Selection for Federated Fine-Tuning
Lei Wang, Jieming Bian, Letian Zhang +1
Large Language Models (LLMs) have demonstrated impressive capabilities across various tasks, but fine-tuning them for domain-specific applications often requires substantial domain…
FedEL: Federated Elastic Learning for Heterogeneous Devices
Letian Zhang, Bo Chen, Jieming Bian +2
Federated learning (FL) enables distributed devices to collaboratively train machine learning models while maintaining data privacy. However, the heterogeneous hardware capabilitie…
FedALT: Federated Fine-Tuning through Adaptive Local Training with Rest-of-World LoRA
Jieming Bian, Lei Wang, Letian Zhang +1
Fine-tuning large language models (LLMs) in federated settings enables privacy-preserving adaptation but suffers from cross-client interference due to model aggregation. Existing f…
LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
Jieming Bian, Lei Wang, Letian Zhang +1
Foundation models (FMs) achieve strong performance across diverse tasks with task-specific fine-tuning, yet full parameter fine-tuning is often computationally prohibitive for larg…
Learning the Optimal Path and DNN Partition for Collaborative Edge Inference
Yin Huang, Letian Zhang, Jie Xu
Recent advancements in Deep Neural Networks (DNNs) have catalyzed the development of numerous intelligent mobile applications and services. However, they also introduce significant…
Taming Cross-Domain Representation Variance in Federated Prototype Learning with Heterogeneous Data Domains
Lei Wang, Jieming Bian, Letian Zhang +2
Federated learning (FL) allows collaborative machine learning training without sharing private data. While most FL methods assume identical data domains across clients, real-world…
Autodidactic Neurosurgeon: Collaborative Deep Inference for Mobile Edge Intelligence via Online Learning
Letian Zhang, Lixing Chen, Jie Xu
Recent breakthroughs in deep learning (DL) have led to the emergence of many intelligent mobile applications and services, but in the meanwhile also pose unprecedented computing ch…