Deep Recurrent Generative Decoder for Abstractive Text Summarization
arXiv:1708.00625
Abstract
We propose a new framework for abstractive text summarization based on a sequence-to-sequence oriented encoder-decoder model equipped with a deep recurrent generative decoder (DRGN). Latent structure information implied in the target summaries is learned based on a recurrent latent random model for improving the summarization quality. Neural variational inference is employed to address the intractable posterior inference for the recurrent latent variables. Abstractive summaries are generated based on both the generative latent variables and the discriminative deterministic states. Extensive experiments on some benchmark datasets in different languages show that DRGN achieves improvements over the state-of-the-art methods.
10 pages, EMNLP 2017
References in corpus (13)
- Deep Learning in Neural Networks: An Overview
- Stochastic Backpropagation and Approximate Inference in Deep Generative Models
- DRAW: A Recurrent Neural Network For Image Generation
- SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documents
- Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyond
- Incorporating Copying Mechanism in Sequence-to-Sequence Learning
- Neural Summarization by Extracting Sentences and Words
- Generating News Headlines with Recurrent Neural Networks
- A Sentence Compression Based Framework to Query-Focused Multi-Document Summarization
- AttSum: Joint Learning of Focusing and Summarization with Neural Attention
- Distraction-Based Neural Networks for Document Summarization
- Controlling Output Length in Neural Encoder-Decoders
- Language as a Latent Variable: Discrete Generative Models for Sentence Compression
Cited by in corpus (8)
- Global Encoding for Abstractive Summarization
- Persona-Aware Tips Generation
- Source-side Prediction for Neural Headline Generation
- Autoencoder as Assistant Supervisor: Improving Text Representation for Chinese Social Media Text Summarization
- Unsupervised Summarization by Jointly Extracting Sentences and Keywords
- Meta-CoTGAN: A Meta Cooperative Training Paradigm for Improving Adversarial Text Generation
- Controllable Length Control Neural Encoder-Decoder via Reinforcement Learning
- End-to-End Code Switching Language Models for Automatic Speech Recognition