activity
20192023
most citedAlign, Mask and Select: A Simple Method for Incorporating Commonsense Knowledge into Language Representation Models

70 citations · 120 across the 10 of their papers we have counts for

collaborators

11 papers

cs.CL2023

Exploiting Correlations Between Contexts and Definitions with Multiple Definition Modeling

Linhan Zhang, Qian Chen, Wen Wang +4

Definition modeling is an important task in advanced natural language applications such as understanding and conversation. Since its introduction, it focus on generating one defini…

cs.CL2023★ 1 cited

Adaptive Knowledge Distillation between Text and Speech Pre-trained Models

Jinjie Ni, Yukun Ma, Wen Wang +7

Learning on a massive amount of speech corpus leads to the recent success of many self-supervised speech models. With knowledge distillation, these models may also benefit from the…

cs.CL2023

Weighted Sampling for Masked Language Modeling

Linhan Zhang, Qian Chen, Wen Wang +5

Masked Language Modeling (MLM) is widely used to pretrain language models. The standard random masking strategy in MLM causes the pre-trained language models (PLMs) to be biased to…

cs.CL2022★ 10 cited

Enhancing Multi-modal and Multi-hop Question Answering via Structured Knowledge and Unified Retrieval-Generation

Qian Yang, Qian Chen, Wen Wang +2

Multi-modal multi-hop question answering involves answering a question by reasoning over multiple input sources from different modalities. Existing methods often retrieve evidences…

cs.CL2020★ 7 cited

Sequential Neural Networks for Noetic End-to-End Response Selection

Qian Chen, Wen Wang

The noetic end-to-end response selection challenge as one track in the 7th Dialog System Technology Challenges (DSTC7) aims to push the state of the art of utterance classification…

cs.CL2020★ 1 cited

Controllable Time-Delay Transformer for Real-Time Punctuation Prediction and Disfluency Detection

Qian Chen, Mengzhe Chen, Bo Li +1

With the increased applications of automatic speech recognition (ASR) in recent years, it is essential to automatically insert punctuation marks and remove disfluencies in transcri…