1.6k citations · 6.6k across the 108 of their papers we have counts for
15 papers · 1 filter
RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking
Ruiyang Ren, Yingqi Qu, Jing Liu +5
In various natural language processing tasks, passage retrieval and passage re-ranking are two key procedures in finding and ranking relevant information. Since both the two proced…
Virtual Data Augmentation: A Robust and General Framework for Fine-tuning Pre-trained Models
Kun Zhou, Wayne Xin Zhao, Sirui Wang +3
Recent works have shown that powerful pre-trained language models (PLM) can be fooled by small perturbations or intentional attacks. To solve this issue, various data augmentation…
Complex Knowledge Base Question Answering: A Survey
Yunshi Lan, Gaole He, Jinhao Jiang +3
Knowledge base question answering (KBQA) aims to answer a question over a knowledge base (KB). Early studies mainly focused on answering simple questions over KBs and achieved grea…
PAIR: Leveraging Passage-Centric Similarity Relation for Improving Dense Passage Retrieval
Ruiyang Ren, Shangwen Lv, Yingqi Qu +6
Recently, dense passage retrieval has become a mainstream approach to finding relevant information in various natural language processing tasks. A number of studies have been devot…
Curriculum Pre-Training Heterogeneous Subgraph Transformer for Top- Recommendation
Hui Wang, Kun Zhou, Wayne Xin Zhao +2
Due to the flexibility in modelling data heterogeneity, heterogeneous information network (HIN) has been adopted to characterize complex and heterogeneous auxiliary data in top-…
Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operators
Peiyu Liu, Ze-Feng Gao, Wayne Xin Zhao +3
This paper presents a novel pre-trained language models (PLM) compression approach based on the matrix product operator (short as MPO) from quantum many-body physics. It can decomp…
Few-shot Knowledge Graph-to-Text Generation with Pretrained Language Models
Junyi Li, Tianyi Tang, Wayne Xin Zhao +3
This paper studies how to automatically generate a natural language text that describes the facts in knowledge graph (KG). Considering the few-shot setting, we leverage the excelle…
Pre-Trained Models: Past, Present and Future
Xu Han, Zhengyan Zhang, Ning Ding +21
Large-scale pre-trained models (PTMs) such as BERT and GPT have recently achieved great success and become a milestone in the field of artificial intelligence (AI). Owing to sophis…
A Survey on Complex Knowledge Base Question Answering: Methods, Challenges and Solutions
Yunshi Lan, Gaole He, Jinhao Jiang +3
Knowledge base question answering (KBQA) aims to answer a question over a knowledge base (KB). Recently, a large number of studies focus on semantically or syntactically complicate…
Pretrained Language Models for Text Generation: A Survey
Junyi Li, Tianyi Tang, Wayne Xin Zhao +1
Text generation has become one of the most important yet challenging tasks in natural language processing (NLP). The resurgence of deep learning has greatly advanced this field by…
Knowledge-based Review Generation by Coherence Enhanced Text Planning
Junyi Li, Wayne Xin Zhao, Zhicheng Wei +2
As a natural language generation task, it is challenging to generate informative and coherent review text. In order to enhance the informativeness of the generated text, existing s…
WenLan: Bridging Vision and Language by Large-Scale Multi-Modal Pre-Training
Yuqi Huo, Manli Zhang, Guangzhen Liu +32
Multi-modal pre-training models have been intensively explored to bridge vision and language in recent years. However, most of them explicitly model the cross-modal interaction bet…
CRSLab: An Open-Source Toolkit for Building Conversational Recommender System
Kun Zhou, Xiaolei Wang, Yuanhang Zhou +5
In recent years, conversational recommender system (CRS) has received much attention in the research community. However, existing studies on CRS vary in scenarios, goals and techni…
Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signals
Gaole He, Yunshi Lan, Jing Jiang +2
Multi-hop Knowledge Base Question Answering (KBQA) aims to find the answer entities that are multiple hops away in the Knowledge Base (KB) from the entities in the question. A majo…
TextBox: A Unified, Modularized, and Extensible Framework for Text Generation
Junyi Li, Tianyi Tang, Gaole He +7
In this paper, we release an open-source library, called TextBox, to provide a unified, modularized, and extensible text generation framework. TextBox aims to support a broad set o…