2 papers
cs.LG2024
Enhancing Zeroth-order Fine-tuning for Language Models with Low-rank Structures
Yiming Chen, Yuan Zhang, Liyuan Cao +2
Parameter-efficient fine-tuning (PEFT) significantly reduces memory costs when adapting large language models (LLMs) for downstream applications. However, traditional first-order (…
math.OC2023
Sharper Convergence Guarantees for Federated Learning with Partial Model Personalization
Yiming Chen, Liyuan Cao, Kun Yuan +1
Partial model personalization, which encompasses both shared and personal variables in its formulation, is a critical optimization problem in federated learning. It balances indivi…