70 citations · 120 across the 10 of their papers we have counts for
Showing 2023Show all
3 papers · 1 filter
cs.CL2023
Exploiting Correlations Between Contexts and Definitions with Multiple Definition Modeling
Linhan Zhang, Qian Chen, Wen Wang +4
Definition modeling is an important task in advanced natural language applications such as understanding and conversation. Since its introduction, it focus on generating one defini…
cs.CL2023★ 1 cited
Adaptive Knowledge Distillation between Text and Speech Pre-trained Models
Jinjie Ni, Yukun Ma, Wen Wang +7
Learning on a massive amount of speech corpus leads to the recent success of many self-supervised speech models. With knowledge distillation, these models may also benefit from the…
cs.CL2023
Weighted Sampling for Masked Language Modeling
Linhan Zhang, Qian Chen, Wen Wang +5
Masked Language Modeling (MLM) is widely used to pretrain language models. The standard random masking strategy in MLM causes the pre-trained language models (PLMs) to be biased to…