171 citations · 280 across the 16 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
cs.CL2022★ 1 cited
WavSpA: Wavelet Space Attention for Boosting Transformers' Long Sequence Learning Ability
Yufan Zhuang, Zihan Wang, Fangbo Tao +1
Transformer and its variants are fundamental neural architectures in deep learning. Recent works show that learning attention in the Fourier space can improve the long sequence lea…
cs.CL2022
WeDef: Weakly Supervised Backdoor Defense for Text Classification
Lesheng Jin, Zihan Wang, Jingbo Shang
Existing backdoor defense methods are only effective for limited trigger types. To defend different trigger types at once, we start from the class-irrelevant nature of the poisonin…
cs.CL2022
Formulating Few-shot Fine-tuning Towards Language Model Pre-training: A Pilot Study on Named Entity Recognition
Zihan Wang, Kewen Zhao, Zilong Wang +1
Fine-tuning pre-trained language models has recently become a common practice in building NLP models for various tasks, especially few-shot tasks. We argue that under the few-shot…