1 citations · 1 across the 3 of their papers we have counts for
5 papers
Rethinking LoRA for Data Heterogeneous Federated Learning: Subspace and State Alignment
Hongyi Peng, Han Yu, Xiaoxiao Li +1
Low-Rank Adaptation (LoRA) is widely used for federated fine-tuning. Yet under non-IID settings, it can substantially underperform full-parameter fine-tuning. Through with-high-pro…
Global Prompt Refinement with Non-Interfering Attention Masking for One-Shot Federated Learning
Zhuang Qi, Pan Yu, Lei Meng +4
Federated Prompt Learning (FPL) enables communication-efficient adaptation by tuning lightweight prompts on top of frozen pre-trained models. Existing FPL methods typically rely on…
PTCMIL: Multiple Instance Learning via Prompt Token Clustering for Whole Slide Image Analysis
Beidi Zhao, SangMook Kim, Hao Chen +4
Multiple Instance Learning (MIL) has advanced WSI analysis but struggles with the complexity and heterogeneity of WSIs. Existing MIL methods face challenges in aggregating diverse…
Class-wise Balancing Data Replay for Federated Class-Incremental Learning
Zhuang Qi, Ying-Peng Tang, Lei Meng +3
Federated Class Incremental Learning (FCIL) aims to collaboratively process continuously increasing incoming tasks across multiple clients. Among various approaches, data replay ha…
Efficient Shapley Value-based Non-Uniform Pruning of Large Language Models
Chuan Sun, Han Yu, Lizhen Cui +1
Pruning large language models (LLMs) is a promising solution for reducing model sizes and computational complexity while preserving performance. Traditional layer-wise pruning meth…