5 citations · 17 across the 15 of their papers we have counts for
17 papers
Rethinking LoRA for Data Heterogeneous Federated Learning: Subspace and State Alignment
Hongyi Peng, Han Yu, Xiaoxiao Li +1
Low-Rank Adaptation (LoRA) is widely used for federated fine-tuning. Yet under non-IID settings, it can substantially underperform full-parameter fine-tuning. Through with-high-pro…
TextResNet: Decoupling and Routing Optimization Signals in Compound AI Systems via Deep Residual Tuning
Suizhi Huang, Mei Li, Han Yu +1
Textual Gradient-style optimizers (TextGrad) enable gradient-like feedback propagation through compound AI systems. However, they do not work well for deep chains. The root cause o…
Toward Federated Large Language Models in Medicine: A Parameter-Efficient Framework for Privacy-Preserving, Multi-Institutional Adaptation
Anran Li, Yuanyuan Chen, Wenjun Long +16
Large language models (LLMs) are increasingly adapted for medical applications, but most are trained using data from a single institution because privacy and governance constraints…
Global Prompt Refinement with Non-Interfering Attention Masking for One-Shot Federated Learning
Zhuang Qi, Pan Yu, Lei Meng +4
Federated Prompt Learning (FPL) enables communication-efficient adaptation by tuning lightweight prompts on top of frozen pre-trained models. Existing FPL methods typically rely on…
PTCMIL: Multiple Instance Learning via Prompt Token Clustering for Whole Slide Image Analysis
Beidi Zhao, SangMook Kim, Hao Chen +4
Multiple Instance Learning (MIL) has advanced WSI analysis but struggles with the complexity and heterogeneity of WSIs. Existing MIL methods face challenges in aggregating diverse…
Class-wise Balancing Data Replay for Federated Class-Incremental Learning
Zhuang Qi, Ying-Peng Tang, Lei Meng +3
Federated Class Incremental Learning (FCIL) aims to collaboratively process continuously increasing incoming tasks across multiple clients. Among various approaches, data replay ha…
Efficient Shapley Value-based Non-Uniform Pruning of Large Language Models
Chuan Sun, Han Yu, Lizhen Cui +1
Pruning large language models (LLMs) is a promising solution for reducing model sizes and computational complexity while preserving performance. Traditional layer-wise pruning meth…
Commute Graph Neural Networks
Wei Zhuo, Han Yu, Guang Tan +1
Graph Neural Networks (GNNs) have shown remarkable success in learning from graph-structured data. However, their application to directed graphs (digraphs) presents unique challeng…
FedCal: Achieving Local and Global Calibration in Federated Learning via Aggregated Parameterized Scaler
Hongyi Peng, Han Yu, Xiaoli Tang +1
Federated learning (FL) enables collaborative machine learning across distributed data owners, but data heterogeneity poses a challenge for model calibration. While prior work focu…
Federated Model Heterogeneous Matryoshka Representation Learning
Liping Yi, Han Yu, Chao Ren +3
Model heterogeneous federated learning (MHeteroFL) enables FL clients to collaboratively train models with heterogeneous structures in a distributed fashion. However, existing MHet…
Agent-oriented Joint Decision Support for Data Owners in Auction-based Federated Learning
Xiaoli Tang, Han Yu, Xiaoxiao Li
Auction-based Federated Learning (AFL) has attracted extensive research interest due to its ability to motivate data owners (DOs) to join FL through economic means. While many exis…
pFedAFM: Adaptive Feature Mixture for Batch-Level Personalization in Heterogeneous Federated Learning
Liping Yi, Han Yu, Chao Ren +4
Model-heterogeneous personalized federated learning (MHPFL) enables FL clients to train structurally different personalized models on non-independent and identically distributed (n…
Intelligent Agents for Auction-based Federated Learning: A Survey
Xiaoli Tang, Han Yu, Xiaoxiao Li +1
Auction-based federated learning (AFL) is an important emerging category of FL incentive mechanism design, due to its ability to fairly and efficiently motivate high-quality data o…
Advances and Open Challenges in Federated Foundation Models
Chao Ren, Han Yu, Hongyi Peng +9
The integration of Foundation Models (FMs) with Federated Learning (FL) presents a transformative paradigm in Artificial Intelligence (AI). This integration offers enhanced capabil…
pFedMoE: Data-Level Personalization with Mixture of Experts for Model-Heterogeneous Personalized Federated Learning
Liping Yi, Han Yu, Chao Ren +4
Federated learning (FL) has been widely adopted for collaborative training on decentralized data. However, it faces the challenges of data, system, and model heterogeneity. This ha…
FedSSA: Semantic Similarity-based Aggregation for Efficient Model-Heterogeneous Personalized Federated Learning
Liping Yi, Han Yu, Zhuan Shi +4
Federated learning (FL) is a privacy-preserving collaboratively machine learning paradigm. Traditional FL requires all data owners (a.k.a. FL clients) to train the same local model…
pFedLoRA: Model-Heterogeneous Personalized Federated Learning with LoRA Tuning
Liping Yi, Han Yu, Gang Wang +2
Federated learning (FL) is an emerging machine learning paradigm in which a central server coordinates multiple participants (clients) collaboratively to train on decentralized dat…