2 citations · 2 across the 7 of their papers we have counts for
9 papers
PLM: Probabilistically Permuted Prophet Language Modeling for Generative Pre-Training
Junwei Bao, Yifan Wang, Jiangyong Ying +4
Conventional autoregressive left-to-right (L2R) sequence generation faces two issues during decoding: limited to unidirectional target sequence modeling, and constrained on strong…
OPERA:Operation-Pivoted Discrete Reasoning over Text
Yongwei Zhou, Junwei Bao, Chaoqun Duan +7
Machine reading comprehension (MRC) that requires discrete reasoning involving symbolic operations, e.g., addition, sorting, and counting, is a challenging task. According to this…
A Survey on Efficient Processing of Similarity Queries over Neural Embeddings
Yifan Wang
Similarity query is the family of queries based on some similarity metrics. Unlike the traditional database queries which are mostly based on value equality, similarity queries aim…
Fine- and Coarse-Granularity Hybrid Self-Attention for Efficient BERT
Jing Zhao, Yifan Wang, Junwei Bao +2
Transformer-based pre-trained models, such as BERT, have shown extraordinary success in achieving state-of-the-art results in many natural language processing applications. However…
RoR: Read-over-Read for Long Document Machine Reading Comprehension
Jing Zhao, Junwei Bao, Yifan Wang +4
Transformer-based pre-trained models, such as BERT, have achieved remarkable results on machine reading comprehension. However, due to the constraint of encoding length (e.g., 512…
CUSTOM: Aspect-Oriented Product Summarization for E-Commerce
Jiahui Liang, Junwei Bao, Yifan Wang +3
Product summarization aims to automatically generate product descriptions, which is of great commercial potential. Considering the customer preferences on different product aspects…