22 citations · 96 across the 9 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2022★ 13 cited
DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models
Zhengfu He, Tianxiang Sun, Kuanning Wang +2
We present DiffusionBERT, a new generative masked language model based on discrete diffusion models. Diffusion models and many pre-trained language models have a shared training ob…
cs.CL2022★ 10 cited
Grad2Task: Improved Few-shot Text Classification Using Gradients for Task Representation
Jixuan Wang, Kuan-Chieh Wang, Frank Rudzicz +1
Large pretrained language models (LMs) like BERT have improved performance in many disparate natural language processing (NLP) tasks. However, fine tuning such models requires a la…