4 papers
Bi-level Personalization for Federated Foundation Models: A Task-vector Aggregation Approach
Yiyuan Yang, Guodong Long, Qinghua Lu +2
Federated foundation models represent a new paradigm to jointly fine-tune pre-trained foundation models across clients. It is still a challenge to fine-tune foundation models for a…
Federated Low-Rank Adaptation for Foundation Models: A Survey
Yiyuan Yang, Guodong Long, Qinghua Lu +3
Effectively leveraging private datasets remains a significant challenge in developing foundation models. Federated Learning (FL) has recently emerged as a collaborative framework t…
Federated Adapter on Foundation Models: An Out-Of-Distribution Approach
Yiyuan Yang, Guodong Long, Tianyi Zhou +3
As foundation models gain prominence, Federated Foundation Models (FedFM) have emerged as a privacy-preserving approach to collaboratively fine-tune models in federated learning (F…
WALL-E 2.0: World Alignment by NeuroSymbolic Learning improves World Model-based LLM Agents
Siyu Zhou, Tianyi Zhou, Yijun Yang +4
Can we build accurate world models out of large language models (LLMs)? How can world models benefit LLM agents? The gap between the prior knowledge of LLMs and the specified envir…