8 citations · 11 across the 3 of their papers we have counts for
3 papers
cs.LG2022★ 8 cited
FedTune: A Deep Dive into Efficient Federated Fine-Tuning with Pre-trained Transformers
Jinyu Chen, Wenchao Xu, Song Guo +3
Federated Learning (FL) is an emerging paradigm that enables distributed users to collaboratively and iteratively train machine learning models without sharing their private data.…
cs.LG2022★ 3 cited
PMR: Prototypical Modal Rebalance for Multimodal Learning
Yunfeng Fan, Wenchao Xu, Haozhao Wang +2
Multimodal learning (MML) aims to jointly exploit the common priors of different modalities to compensate for their inherent limitations. However, existing MML methods often optimi…
cs.CV2022
Demystify Self-Attention in Vision Transformers from a Semantic Perspective: Analysis and Application
Leijie Wu, Song Guo, Yaohong Ding +4
Self-attention mechanisms, especially multi-head self-attention (MSA), have achieved great success in many fields such as computer vision and natural language processing. However,…