315 citations · 612 across the 33 of their papers we have counts for
49 papers
NoisyTune: A Little Noise Can Help You Finetune Pretrained Language Models Better
Chuhan Wu, Fangzhao Wu, Tao Qi +2
Effectively finetuning pretrained language models (PLMs) is critical for their success in downstream tasks. However, PLMs may have risks in overfitting the pretraining tasks and da…
FedAttack: Effective and Covert Poisoning Attack on Federated Recommendation via Hard Sampling
Chuhan Wu, Fangzhao Wu, Tao Qi +2
Federated learning (FL) is a feasible technique to learn personalized recommendation models from decentralized user data. Unfortunately, federated recommender systems are vulnerabl…
Uni-FedRec: A Unified Privacy-Preserving News Recommendation Framework for Model Training and Online Serving
Tao Qi, Fangzhao Wu, Chuhan Wu +2
News recommendation is important for personalized online news services. Most existing news recommendation methods rely on centrally stored user behavior data to both train models o…
Fastformer: Additive Attention Can Be All You Need
Chuhan Wu, Fangzhao Wu, Tao Qi +2
Transformer is a powerful model for text understanding. However, it is inefficient due to its quadratic complexity to input sequence length. Although there are many methods on Tran…
UserBERT: Contrastive User Model Pre-training
Chuhan Wu, Fangzhao Wu, Yang Yu +3
User modeling is critical for personalized web applications. Existing user modeling methods usually train user models from user behaviors with task-specific labeled data. However,…
Smart Bird: Learnable Sparse Attention for Efficient and Effective Transformer
Chuhan Wu, Fangzhao Wu, Tao Qi +4
Transformer has achieved great success in NLP. However, the quadratic complexity of the self-attention mechanism in Transformer makes it inefficient in handling long sequences. Man…