33 citations · 162 across the 52 of their papers we have counts for
5 papers · 1 filter
Order-Level Attention Similarity Across Language Models: A Latent Commonality
Jinglin Liang, Jin Zhong, Shuangping Huang +5
In this paper, we explore an important yet previously neglected question: Do context aggregation patterns across Language Models (LMs) share commonalities? While some works have in…
Large-Small Model Collaborative Framework for Federated Continual Learning
Hao Yu, Xin Yang, Boyang Fan +4
Continual learning (CL) for Foundation Models (FMs) is an essential yet underexplored challenge, especially in Federated Continual Learning (FCL), where each client learns from a p…
Ten Challenging Problems in Federated Foundation Models
Tao Fan, Hanlin Gu, Xuemei Cao +30
Federated Foundation Models (FedFMs) represent a distributed learning paradigm that fuses general competences of foundation models as well as privacy-preserving capabilities of fed…
Vertical Federated Learning in Practice: The Good, the Bad, and the Ugly
Zhaomin Wu, Zhen Qin, Junyi Hou +4
Vertical Federated Learning (VFL) is a privacy-preserving collaborative learning paradigm that enables multiple parties with distinct feature sets to jointly train machine learning…
PPC-GPT: Federated Task-Specific Compression of Large Language Models via Pruning and Chain-of-Thought Distillation
Tao Fan, Guoqiang Ma, Yuanfeng Song +2
Compressing Large Language Models (LLMs) into task-specific Small Language Models (SLMs) encounters two significant challenges: safeguarding domain-specific knowledge privacy and m…