500 citations · 1.6k across the 68 of their papers we have counts for
9 papers · 2 filters
PLM: Probabilistically Permuted Prophet Language Modeling for Generative Pre-Training
Junwei Bao, Yifan Wang, Jiangyong Ying +4
Conventional autoregressive left-to-right (L2R) sequence generation faces two issues during decoding: limited to unidirectional target sequence modeling, and constrained on strong…
MuGER: Multi-Granularity Evidence Retrieval and Reasoning for Hybrid Question Answering
Yingyao Wang, Junwei Bao, Chaoqun Duan +3
Hybrid question answering (HQA) aims to answer questions over heterogeneous data, including tables and passages linked to table cells. The heterogeneous data can provide different…
UniRPG: Unified Discrete Reasoning over Table and Text as Program Generation
Yongwei Zhou, Junwei Bao, Chaoqun Duan +3
Question answering requiring discrete reasoning, e.g., arithmetic computing, comparison, and counting, over knowledge is a challenging task. In this paper, we propose UniRPG, a sem…
LUNA: Learning Slot-Turn Alignment for Dialogue State Tracking
Yifan Wang, Jing Zhao, Junwei Bao +3
Dialogue state tracking (DST) aims to predict the current dialogue state given the dialogue history. Existing methods generally exploit the utterances of all dialogue turns to assi…
BORT: Back and Denoising Reconstruction for End-to-End Task-Oriented Dialog
Haipeng Sun, Junwei Bao, Youzheng Wu +1
A typical end-to-end task-oriented dialog system transfers context into dialog state, and upon which generates a response, which usually faces the problem of error propagation from…
OPERA:Operation-Pivoted Discrete Reasoning over Text
Yongwei Zhou, Junwei Bao, Chaoqun Duan +7
Machine reading comprehension (MRC) that requires discrete reasoning involving symbolic operations, e.g., addition, sorting, and counting, is a challenging task. According to this…
Label Anchored Contrastive Learning for Language Understanding
Zhenyu Zhang, Yuming Zhao, Meng Chen +1
Contrastive learning (CL) has achieved astonishing progress in computer vision, speech, and natural language processing fields recently with self-supervised learning. However, CL a…
Building Robust Spoken Language Understanding by Cross Attention between Phoneme Sequence and ASR Hypothesis
Zexun Wang, Yuquan Le, Yi Zhu +4
Building Spoken Language Understanding (SLU) robust to Automatic Speech Recognition (ASR) errors is an essential issue for various voice-enabled virtual assistants. Considering tha…
Fine- and Coarse-Granularity Hybrid Self-Attention for Efficient BERT
Jing Zhao, Yifan Wang, Junwei Bao +2
Transformer-based pre-trained models, such as BERT, have shown extraordinary success in achieving state-of-the-art results in many natural language processing applications. However…