8 papers · 1 filter
Beyond End-to-End: Dynamic Chain Optimization for Private LLM Adaptation on the Edge
Yebo Wu, Jingguang Li, Chunlin Tian +3
Federated fine-tuning enables privacy-preserving LLM adaptation but faces a critical bottleneck: the disparity between LLMs' high memory demands and edge devices' limited capacity.…
Floe: Federated Specialization for Real-Time LLM-SLM Inference
Chunlin Tian, Kahou Tam, Yebo Wu +4
Deploying large language models (LLMs) in real-time systems remains challenging due to their substantial computational demands and privacy concerns. We propose Floe, a hybrid feder…
Elastic Mixture of Rank-Wise Experts for Knowledge Reuse in Federated Fine-Tuning
Yebo Wu, Jingguang Li, Zhijiang Guo +1
Federated fine-tuning offers a promising solution for adapting Large Language Models (LLMs) to downstream tasks while safeguarding data privacy. However, its high computational and…
Memory-Efficient Federated Fine-Tuning of Large Language Models via Layer Pruning
Yebo Wu, Jingguang Li, Chunlin Tian +2
Federated fine-tuning enables privacy-preserving Large Language Model (LLM) adaptation, but its high memory cost limits participation from resource-constrained devices. We propose…
Breaking the Memory Wall for Heterogeneous Federated Learning via Model Splitting
Chunlin Tian, Li Li, Kahou Tam +2
Federated Learning (FL) enables multiple devices to collaboratively train a shared model while preserving data privacy. Ever-increasing model complexity coupled with limited memory…
Heterogeneity-Aware Memory Efficient Federated Learning via Progressive Layer Freezing
Wu Yebo, Li Li, Tian Chunlin +4
In this paper, we propose SmartFreeze, a framework that effectively reduces the memory footprint by conducting the training in a progressive manner. Instead of updating the full mo…