activity
20232026
most citedFLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations

4 citations · 12 across the 28 of their papers we have counts for

collaborators
Showing 2024Show all

7 papers · 1 filter

cs.LG2024

Towards counterfactual fairness through auxiliary variables

Bowei Tian, Ziyao Wang, Shwai He +5

The challenge of balancing fairness and predictive accuracy in machine learning models, especially when sensitive attributes such as race, gender, or age are considered, has motiva…

cs.CV2024

SPARC: Scalable Path-Specific Counterfactual Fairness via Causal Conditional Independence

Bowei Tian, Yexiao He, Ziyao Wang +3

Deep learning models exhibit fairness concerns when predictions are inadvertently influenced by sensitive attributes. However, existing attempts to make Path-Specific Counterfactua…

cs.LG2024

Revisiting Federated Fine-Tuning: A Single Communication Round is Enough for Foundation Models

Ziyao Wang, Bowei Tian, Yexiao He +6

The recent advancement of foundation models (FMs) has increased the demand for fine-tuning these models on large-scale cross-domain datasets. To address this, federated fine-tuning…

cs.LG2024

Model-GLUE: Democratized LLM Scaling for A Large Model Zoo in the Wild

Xinyu Zhao, Guoheng Sun, Ruisi Cai +13

As Large Language Models (LLMs) excel across tasks and specialized domains, scaling LLMs based on existing models has garnered significant attention, which faces the challenge of d…

cs.CR2024★ 2 cited

Moderator: Moderating Text-to-Image Diffusion Models through Fine-grained Context-based Policies

Peiran Wang, Qiyu Li, Longxuan Yu +3

We present Moderator, a policy-based model management system that allows administrators to specify fine-grained content moderation policies and modify the weights of a text-to-imag…

cs.LG2024★ 4 cited

FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations

Ziyao Wang, Zheyu Shen, Yexiao He +4

The rapid development of Large Language Models (LLMs) has been pivotal in advancing AI, with pre-trained LLMs being adaptable to diverse downstream tasks through fine-tuning. Feder…

cs.CL2024

SHED: Shapley-Based Automated Dataset Refinement for Instruction Fine-Tuning

Yexiao He, Ziyao Wang, Zheyu Shen +5

The pre-trained Large Language Models (LLMs) can be adapted for many downstream tasks and tailored to align with human preferences through fine-tuning. Recent studies have discover…