12 citations · 37 across the 9 of their papers we have counts for
9 papers
On the Evolution of Federated Post-Training Large Language Models: A Model Accessibility View
Tao Guo, Junxiao Wang, Fushuo Huo +4
Federated Learning (FL) enables training models across decentralized data silos while preserving client data privacy. Recent research has explored efficient methods for post-traini…
On Knowledge Editing in Federated Learning: Perspectives, Challenges, and Future Directions
Leijie Wu, Song Guo, Junxiao Wang +3
As Federated Learning (FL) has gained increasing attention, it has become widely acknowledged that straightforwardly applying stochastic gradient descent (SGD) on the overall frame…
DualMix: Unleashing the Potential of Data Augmentation for Online Class-Incremental Learning
Yunfeng Fan, Wenchao Xu, Haozhao Wang +3
Online Class-Incremental (OCI) learning has sparked new approaches to expand the previously trained model knowledge from sequentially arriving data streams with new classes. Unfort…
FedTune: A Deep Dive into Efficient Federated Fine-Tuning with Pre-trained Transformers
Jinyu Chen, Wenchao Xu, Song Guo +3
Federated Learning (FL) is an emerging paradigm that enables distributed users to collaboratively and iteratively train machine learning models without sharing their private data.…
PMR: Prototypical Modal Rebalance for Multimodal Learning
Yunfeng Fan, Wenchao Xu, Haozhao Wang +2
Multimodal learning (MML) aims to jointly exploit the common priors of different modalities to compensate for their inherent limitations. However, existing MML methods often optimi…
Demystify Self-Attention in Vision Transformers from a Semantic Perspective: Analysis and Application
Leijie Wu, Song Guo, Yaohong Ding +4
Self-attention mechanisms, especially multi-head self-attention (MSA), have achieved great success in many fields such as computer vision and natural language processing. However,…
PromptFL: Let Federated Participants Cooperatively Learn Prompts Instead of Models -- Federated Learning in Age of Foundation Model
Tao Guo, Song Guo, Junxiao Wang +1
Quick global aggregation of effective distributed parameters is crucial to federated learning (FL), which requires adequate bandwidth for parameters communication and sufficient us…
A Survey on Gradient Inversion: Attacks, Defenses and Future Directions
Rui Zhang, Song Guo, Junxiao Wang +2
Recent studies have shown that the training samples can be recovered from gradients, which are called Gradient Inversion (GradInv) attacks. However, there remains a lack of extensi…
Efficient Attribute Unlearning: Towards Selective Removal of Input Attributes from Feature Representations
Tao Guo, Song Guo, Jiewei Zhang +2
Recently, the enactment of privacy regulations has promoted the rise of the machine unlearning paradigm. Existing studies of machine unlearning mainly focus on sample-wise unlearni…