FLoKD: Adaptive Knowledge Distillation for Federated Low-Rank LLM over Wireless Networks

Xinlu Zhang, Na Yan, Yang Su +2

Large language models (LLMs) have demonstrated strong capabilities across a wide range of natural language processing tasks. However, conventional fine-tuning typically relies on c…