activity
20222025
most citedFederated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes

8 citations · 12 across the 8 of their papers we have counts for

collaborators
Showing cs.LGShow all

5 papers · 1 filter

cs.LG2024

Personalized Federated Fine-Tuning for LLMs via Data-Driven Heterogeneous Model Architectures

Yicheng Zhang, Zhen Qin, Zhaomin Wu +2

Large language models (LLMs) are increasingly powering web-based applications, whose effectiveness relies on fine-tuning with large-scale instruction data. However, such data often…

cs.LG2024

Federated Data-Efficient Instruction Tuning for Large Language Models

Zhen Qin, Zhaomin Wu, Bingsheng He +1

Instruction tuning is a crucial step in improving the responsiveness of pretrained large language models (LLMs) to human instructions. Federated learning (FL) helps to exploit the…

cs.LG2023★ 8 cited

Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes

Zhen Qin, Daoyuan Chen, Bingchen Qian +3

Pre-trained large language models (LLMs) need fine-tuning to improve their responsiveness to natural language instructions. Federated learning offers a way to fine-tune LLMs using…

cs.LG2023

Learning Multi-Pattern Normalities in the Frequency Domain for Efficient Time Series Anomaly Detection

Feiyi Chen, Yingying zhang, Zhen Qin +5

Anomaly detection significantly enhances the robustness of cloud systems. While neural network-based methods have recently demonstrated strong advantages, they encounter practical…

cs.LG2023★ 1 cited

LARA: A Light and Anti-overfitting Retraining Approach for Unsupervised Time Series Anomaly Detection

Feiyi Chen, Zhen Qin, Yingying Zhang +4

Most of current anomaly detection models assume that the normal pattern remains same all the time. However, the normal patterns of Web services change dramatically and frequently.…