86 citations · 232 across the 11 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CL2022★ 2 cited
Momentum Contrastive Pre-training for Question Answering
Minda Hu, Muzhi Li, Yasheng Wang +1
Existing pre-training methods for extractive Question Answering (QA) generate cloze-like queries different from natural questions in syntax structure, which could overfit pre-train…
cs.CL2022★ 6 cited
Sparse Structure Search for Parameter-Efficient Tuning
Shengding Hu, Zhen Zhang, Ning Ding +4
Adapting large pre-trained models (PTMs) through fine-tuning imposes prohibitive computational and storage burdens. Recent studies of parameter-efficient tuning (PET) find that onl…