Title-Guided Encoding for Keyphrase Generation
arXiv:1808.08575
Abstract
Keyphrase generation (KG) aims to generate a set of keyphrases given a document, which is a fundamental task in natural language processing (NLP). Most previous methods solve this problem in an extractive manner, while recently, several attempts are made under the generative setting using deep neural networks. However, the state-of-the-art generative methods simply treat the document title and the document main body equally, ignoring the leading role of the title to the overall document. To solve this problem, we introduce a new model called Title-Guided Network (TG-Net) for automatic keyphrase generation task based on the encoder-decoder architecture with two new features: (i) the title is additionally employed as a query-like input, and (ii) a title-guided encoder gathers the relevant information from the title to each word in the document. Experiments on a range of KG datasets demonstrate that our model outperforms the state-of-the-art models with a large margin, especially for documents with either very low or very high title length ratios.
arXiv commentAAAI 19
References in corpus (15)
- Adam: A Method for Stochastic Optimization
- Neural Machine Translation by Jointly Learning to Align and Translate
- Sequence to Sequence Learning with Neural Networks
- Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
- Convolutional Sequence to Sequence Learning
- Language Modeling with Gated Convolutional Networks
- Effective Approaches to Attention-based Neural Machine Translation
- Machine Comprehension Using Match-LSTM and Answer Pointer
- Incorporating Copying Mechanism in Sequence-to-Sequence Learning
- A Joint Model for Question Answering and Question Generation
- A Unified Query-based Generative Model for Question Generation and Question Answering
- Generating Distractors for Reading Comprehension Questions from Real Examinations
- Semi-Supervised Learning for Neural Keyphrase Generation
- Keyphrase Generation with Correlation Constraints
- Learning Feature Representations for Keyphrase Extraction