most citedAdaptive Rank Allocation for Federated Parameter-Efficient Fine-Tuning of Language Models

5 citations · 5 across the 5 of their papers we have counts for

collaborators
Showing cs.LGShow all

2 papers · 1 filter

cs.LG2026

Preventing Rank Collapse in Federated Low-Rank Adaptation with Client Heterogeneity

Fei Wu, Jia Hu, Geyong Min +1

Federated low-rank adaptation (FedLoRA) has facilitated communication-efficient and privacy-preserving fine-tuning of foundation models for downstream tasks. In practical federated…

cs.LG2025

Efficient Orthogonal Fine-Tuning with Principal Subspace Adaptation

Fei Wu, Jia Hu, Geyong Min +1

Driven by the rapid growth of model parameters, parameter-efficient fine-tuning (PEFT) has become essential for adapting large models to diverse downstream tasks under constrained…