4 citations · 13 across the 11 of their papers we have counts for
4 papers · 1 filter
Revisiting Federated Fine-Tuning: A Single Communication Round is Enough for Foundation Models
Ziyao Wang, Bowei Tian, Yexiao He +6
The recent advancement of foundation models (FMs) has increased the demand for fine-tuning these models on large-scale cross-domain datasets. To address this, federated fine-tuning…
Moderator: Moderating Text-to-Image Diffusion Models through Fine-grained Context-based Policies
Peiran Wang, Qiyu Li, Longxuan Yu +3
We present Moderator, a policy-based model management system that allows administrators to specify fine-grained content moderation policies and modify the weights of a text-to-imag…
FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations
Ziyao Wang, Zheyu Shen, Yexiao He +4
The rapid development of Large Language Models (LLMs) has been pivotal in advancing AI, with pre-trained LLMs being adaptable to diverse downstream tasks through fine-tuning. Feder…
SHED: Shapley-Based Automated Dataset Refinement for Instruction Fine-Tuning
Yexiao He, Ziyao Wang, Zheyu Shen +5
The pre-trained Large Language Models (LLMs) can be adapted for many downstream tasks and tailored to align with human preferences through fine-tuning. Recent studies have discover…