28 citations · 52 across the 5 of their papers we have counts for
5 papers
YouZhi: Towards High-Concurrency Financial LLMs via Adaptive GQA-to-MLA Transition
PSBC LLM Team, Huawei LLM Team, Ruihan Long +56
Large language models (LLMs) drive significant financial innovations, yet their high-concurrency deployment is severely bottlenecked by KV cache memory overhead, which inflates inf…
FwdLLM: Efficient FedLLM using Forward Gradient
Mengwei Xu, Dongqi Cai, Yaozong Wu +2
Large Language Models (LLMs) are transforming the landscape of mobile intelligence. Federated Learning (FL), a method to preserve user data privacy, is often employed in fine-tunin…
Federated Few-Shot Learning for Mobile NLP
Dongqi Cai, Shangguang Wang, Yaozong Wu +2
Natural language processing (NLP) sees rich mobile applications. To support various language understanding tasks, a foundation NLP model is often fine-tuned in a federated, privacy…
Towards Practical Few-shot Federated NLP
Dongqi Cai, Yaozong Wu, Haitao Yuan +3
Transformer-based pre-trained models have emerged as the predominant solution for natural language processing (NLP). Fine-tuning such pre-trained models for downstream tasks often…
FedAdapter: Efficient Federated Learning for Modern NLP
Dongqi Cai, Yaozong Wu, Shangguang Wang +2
Transformer-based pre-trained models have revolutionized NLP for superior performance and generality. Fine-tuning pre-trained models for downstream tasks often requires private dat…