activity
20202026
most citedFATE-LLM: A Industrial Grade Federated Learning Framework for Large Language Models

33 citations · 162 across the 52 of their papers we have counts for

collaborators
Showing 2024Show all

18 papers · 1 filter

cs.CV2024

Handling Spatial-Temporal Data Heterogeneity for Federated Continual Learning via Tail Anchor

Hao Yu, Xin Yang, Le Zhang +4

Federated continual learning (FCL) allows each client to continually update its knowledge from task streams, enhancing the applicability of federated learning in real-world scenari…

cs.CL2024

Federated Co-tuning Framework for Large and Small Language Models

Tao Fan, Yan Kang, Guoqiang Ma +4

By adapting Large Language Models (LLMs) to domain-specific tasks or enriching them with domain-specific knowledge, we can fully harness the capabilities of LLMs. Nonetheless, a ga…

cs.DC2024

Disentangling data distribution for Federated Learning

Xinyuan Zhao, Hanlin Gu, Lixin Fan +2

Federated Learning (FL) facilitates collaborative training of a global model whose performance is boosted by private data owned by distributed clients, without compromising data pr…

cs.LG2024★ 1 cited

Towards Privacy-Guaranteed Label Unlearning in Vertical Federated Learning: Few-Shot Forgetting without Disclosure

Hanlin Gu, Hong Xi Tae, Lixin Fan +1

This paper addresses the critical challenge of unlearning in Vertical Federated Learning (VFL), a setting that has received far less attention than its horizontal counterpart. Spec…

cs.LG2024

Model-based Large Language Model Customization as Service

Zhaomin Wu, Jizhou Guo, Junyi Hou +3

Prominent Large Language Model (LLM) services from providers like OpenAI and Google excel at general tasks but often underperform on domain-specific applications. Current customiza…

cs.LG2024

Diffusion-Driven Data Replay: A Novel Approach to Combat Forgetting in Federated Class Continual Learning

Jinglin Liang, Jin Zhong, Hanlin Gu +6

Federated Class Continual Learning (FCCL) merges the challenges of distributed client learning with the need for seamless adaptation to new classes without forgetting old ones. The…

cs.CR2024

FedAdOb: Privacy-Preserving Federated Deep Learning with Adaptive Obfuscation

Hanlin Gu, Jiahuan Luo, Yan Kang +5

Federated learning (FL) has emerged as a collaborative approach that allows multiple clients to jointly learn a machine learning model without sharing their private data. The conce…

cs.CL2024★ 1 cited

FedCoT: Federated Chain-of-Thought Distillation for Large Language Models

Tao Fan, Weijing Chen, Yan Kang +5

Large Language Models (LLMs) have emerged as a transformative force in artificial intelligence, demonstrating exceptional proficiency across various tasks. However, their deploymen…

cs.CL2024★ 5 cited

FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language Models

Tao Fan, Guoqiang Ma, Yan Kang +5

Recent research in federated large language models (LLMs) has primarily focused on enabling clients to fine-tune their locally deployed homogeneous LLMs collaboratively or on trans…

cs.CR2024★ 4 cited

Federated Domain-Specific Knowledge Transfer on Large Language Models Using Synthetic Data

Haoran Li, Xinyuan Zhao, Dadi Guo +6

As large language models (LLMs) demonstrate unparalleled performance and generalization ability, LLMs are widely used and integrated into various applications. When it comes to sen…

cs.LG2024★ 1 cited

A Survey on Contribution Evaluation in Vertical Federated Learning

Yue Cui, Chung-ju Huang, Yuzhu Zhang +4

Vertical Federated Learning (VFL) has emerged as a critical approach in machine learning to address privacy concerns associated with centralized data storage and processing. VFL fa…

cs.CR2024

No Free Lunch Theorem for Privacy-Preserving LLM Inference

Xiaojin Zhang, Yahao Pang, Yan Kang +4

Individuals and businesses have been significantly benefited by Large Language Models (LLMs) including PaLM, Gemini and ChatGPT in various ways. For example, LLMs enhance productiv…

cs.LG2024★ 3 cited

Ferrari: Federated Feature Unlearning via Optimizing Feature Sensitivity

Hanlin Gu, Win Kent Ong, Chee Seng Chan +1

The advent of Federated Learning (FL) highlights the practical necessity for the right to be forgotten for all clients, allowing them to request data deletion from the machine lear…

cs.LG2024

Unlearning during Learning: An Efficient Federated Machine Unlearning Method

Hanlin Gu, Gongxi Zhu, Jie Zhang +4

In recent years, Federated Learning (FL) has garnered significant attention as a distributed machine learning paradigm. To facilitate the implementation of the right to be forgotte…

cs.AI2024

FedEval-LLM: Federated Evaluation of Large Language Models on Downstream Tasks with Collective Wisdom

Yuanqin He, Yan Kang, Lixin Fan +1

Federated Learning (FL) has emerged as a promising solution for collaborative training of large language models (LLMs). However, the integration of LLMs into FL introduces new chal…

cs.LG2024

Hyperparameter Optimization for SecureBoost via Constrained Multi-Objective Federated Learning

Yan Kang, Ziyao Ren, Lixin Fan +3

SecureBoost is a tree-boosting algorithm that leverages homomorphic encryption (HE) to protect data privacy in vertical federated learning. SecureBoost and its variants have been w…

cs.LG2024★ 2 cited

FedMIA: An Effective Membership Inference Attack Exploiting "All for One" Principle in Federated Learning

Gongxi Zhu, Donghao Li, Hanlin Gu +3

Federated Learning (FL) is a promising approach for training machine learning models on decentralized data while preserving privacy. However, privacy risks, particularly Membership…

cs.LG2024

A Theoretical Analysis of Efficiency Constrained Utility-Privacy Bi-Objective Optimization in Federated Learning

Hanlin Gu, Xinyuan Zhao, Gongxi Zhu +4

Federated learning (FL) enables multiple clients to collaboratively learn a shared model without sharing their individual data. Concerns about utility, privacy, and training effici…