4 papers
Diversified Scaling Inference in Time Series Foundation Models
Ruijin Hua, Zichuan Liu, Kun Zhang +1
The advancement of Time Series Foundation Models (TSFMs) has been driven primarily by large-scale pre-training, but inference-time compute potential remains largely untapped. This…
Bi-level Personalization for Federated Foundation Models: A Task-vector Aggregation Approach
Yiyuan Yang, Guodong Long, Qinghua Lu +2
Federated foundation models represent a new paradigm to jointly fine-tune pre-trained foundation models across clients. It is still a challenge to fine-tune foundation models for a…
Federated Low-Rank Adaptation for Foundation Models: A Survey
Yiyuan Yang, Guodong Long, Qinghua Lu +3
Effectively leveraging private datasets remains a significant challenge in developing foundation models. Federated Learning (FL) has recently emerged as a collaborative framework t…
Federated Adapter on Foundation Models: An Out-Of-Distribution Approach
Yiyuan Yang, Guodong Long, Tianyi Zhou +3
As foundation models gain prominence, Federated Foundation Models (FedFM) have emerged as a privacy-preserving approach to collaboratively fine-tune models in federated learning (F…