12 citations · 25 across the 20 of their papers we have counts for
9 papers · 1 filter
Bi-level Personalization for Federated Foundation Models: A Task-vector Aggregation Approach
Yiyuan Yang, Guodong Long, Qinghua Lu +2
Federated foundation models represent a new paradigm to jointly fine-tune pre-trained foundation models across clients. It is still a challenge to fine-tune foundation models for a…
FeDaL: Federated Dataset Learning for General Time Series Foundation Models
Shengchao Chen, Guodong Long, Michael Blumenstein +1
Dataset-level heterogeneity introduces significant domain biases that fundamentally degrade generalization on general Time Series Foundation Models (TSFMs), yet this challenge rema…
Raw Data Matters: Enhancing Prompt Tuning by Internal Augmentation on Vision-Language Models
Haoyang Li, Liang Wang, Chao Wang +4
For CLIP-based prompt tuning, introducing more data as additional knowledge for enhancing fine-tuning process is proved to be an effective approach. Existing data amplification str…
Federated Low-Rank Adaptation for Foundation Models: A Survey
Yiyuan Yang, Guodong Long, Qinghua Lu +3
Effectively leveraging private datasets remains a significant challenge in developing foundation models. Federated Learning (FL) has recently emerged as a collaborative framework t…
Federated Adapter on Foundation Models: An Out-Of-Distribution Approach
Yiyuan Yang, Guodong Long, Tianyi Zhou +3
As foundation models gain prominence, Federated Foundation Models (FedFM) have emerged as a privacy-preserving approach to collaboratively fine-tune models in federated learning (F…
WALL-E 2.0: World Alignment by NeuroSymbolic Learning improves World Model-based LLM Agents
Siyu Zhou, Tianyi Zhou, Yijun Yang +4
Can we build accurate world models out of large language models (LLMs)? How can world models benefit LLM agents? The gap between the prior knowledge of LLMs and the specified envir…
FedMerge: Federated Personalization via Model Merging
Shutong Chen, Tianyi Zhou, Guodong Long +2
One global model in federated learning (FL) might not be sufficient to serve many clients with non-IID tasks and distributions. While there has been advances in FL to train multipl…
MAO: Efficient Model-Agnostic Optimization of Prompt Tuning for Vision-Language Models
Haoyang Li, Siyu Zhou, Liang Wang +1
Though CLIP-based prompt tuning significantly enhances pre-trained Vision-Language Models, existing research focuses on reconstructing the model architecture, e.g., additional loss…
DPC: Dual-Prompt Collaboration for Tuning Vision-Language Models
Haoyang Li, Liang Wang, Chao Wang +3
The Base-New Trade-off (BNT) problem universally exists during the optimization of CLIP-based prompt tuning, where continuous fine-tuning on base (target) classes leads to a simult…