23 citations · 30 across the 5 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.CL2023
Preserving Commonsense Knowledge from Pre-trained Language Models via Causal Inference
Junhao Zheng, Qianli Ma, Shengjie Qiu +6
Fine-tuning has been proven to be a simple and effective technique to transfer the learned knowledge of Pre-trained Language Models (PLMs) to downstream tasks. However, vanilla fin…
cs.CL2023★ 4 cited
Perturbation-based Self-supervised Attention for Attention Bias in Text Classification
Huawen Feng, Zhenxi Lin, Qianli Ma
In text classification, the traditional attention mechanisms usually focus too much on frequent words, and need extensive labeled data in order to learn. This paper proposes a pert…