SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documents

Abstract

We present SummaRuNNer, a Recurrent Neural Network (RNN) based sequence model for extractive summarization of documents and show that it achieves performance better than or comparable to state-of-the-art. Our model has the additional advantage of being very interpretable, since it allows visualization of its predictions broken up by abstract features such as information content, salience and novelty. Another novel contribution of our work is abstractive training of our extractive model that can train on human generated reference summaries alone, eliminating the need for sentence-level extractive labels.

Published at AAAI 2017, The Thirty-First AAAI Conference on Artificial Intelligence (AAAI-2017)

Cited by in corpus (193)

• A Deep Reinforced Model for Abstractive Summarization
• PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization
• Natural Language Processing Advancements By Deep Learning: A Survey
• WikiHow: A Large Scale Text Summarization Dataset
• Text Summarization with Pretrained Encoders
• Pretrained Language Models for Sequential Sentence Classification
• Get To The Point: Summarization with Pointer-Generator Networks
• Abstract Meaning Representation for Multi-Document Summarization
• Fast Abstractive Summarization with Reinforce-Selected Sentence Rewriting
• ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training
• Neural Abstractive Text Summarization with Sequence-to-Sequence Models
• Neural Extractive Summarization with Side Information
• Abstractive Summarization of Reddit Posts with Multi-level Memory Networks
• HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization
• Graph-based Neural Multi-Document Summarization
• Text Summarization using Abstract Meaning Representation
• Efficient Adaptation of Pretrained Transformers for Abstractive Summarization
• Exploring Domain Shift in Extractive Text Summarization
• Heterogeneous Graph Neural Networks for Extractive Document Summarization
• Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization
• Learning with fuzzy hypergraphs: a topical approach to query-oriented text summarization
• Deep Recurrent Generative Decoder for Abstractive Text Summarization
• Extractive Summarization of Call Transcripts
• Learning to Extract Coherent Summary via Deep Reinforcement Learning
• Investigating Entropy for Extractive Document Summarization
• QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization
• Neural Extractive Text Summarization with Syntactic Compression
• Controllable Abstractive Summarization
• On Extractive and Abstractive Neural Document Summarization with Transformer Language Models
• A Unified Model for Extractive and Abstractive Summarization using Inconsistency Loss
• BanditSum: Extractive Summarization as a Contextual Bandit
• Incorporating Commonsense Knowledge into Abstractive Dialogue Summarization via Heterogeneous Graph Networks
• A Survey on Neural Network-Based Summarization Methods
• Sentence Centrality Revisited for Unsupervised Summarization
• Discourse-Aware Neural Extractive Text Summarization
• Searching for Effective Neural Extractive Summarization: What Works and What's Next
• A Multi-task Learning Approach for Improving Product Title Compression with User Search Log Data
• Topic Augmented Generator for Abstractive Summarization
• Multi-modal Summarization for Video-containing Documents
• Extractive Summarization as Text Matching
• Attention Optimization for Abstractive Document Summarization
• A Survey on Recent Advances in Sequence Labeling from Deep Learning Models
• Neural Document Summarization by Jointly Learning to Score and Select Sentences
• Systematically Exploring Redundancy Reduction in Summarizing Long Documents
• Generating Informative CVE Description From ExploitDB Posts by Extractive Summarization
• GSum: A General Framework for Guided Neural Abstractive Summarization
• DSGPT: Domain-Specific Generative Pre-Training of Transformers for Text Generation in E-commerce Title and Review Summarization
• A Condense-then-Select Strategy for Text Summarization
• Biomedical text summarization using Conditional Generative Adversarial Network(CGAN)
• SEAL: Segment-wise Extractive-Abstractive Long-form Text Summarization
• RetrievalSum: A Retrieval Enhanced Framework for Abstractive Summarization
• What comes next? Extractive summarization by next-sentence prediction
• From the Token to the Review: A Hierarchical Multimodal approach to Opinion Mining
• Abstractive Summarization Using Attentive Neural Techniques
• Continual BERT: Continual Learning for Adaptive Extractive Summarization of COVID-19 Literature
• Massive Multi-Document Summarization of Product Reviews with Weak Supervision
• Language Model as an Annotator: Exploring DialoGPT for Dialogue Summarization
• Literature Retrieval for Precision Medicine with Neural Matching and Faceted Summarization
• CO2Sum:Contrastive Learning for Factual-Consistent Abstractive Summarization
• Dimsum @LaySumm 20: BART-based Approach for Scientific Document Summarization
• Unsupervised Pseudo-Labeling for Extractive Summarization on Electronic Health Records
• Summary Level Training of Sentence Rewriting for Abstractive Summarization
• Reducing Quantity Hallucinations in Abstractive Summarization
• Pragmatically Informative Text Generation
• Attributed Rhetorical Structure Grammar for Domain Text Summarization
• Classification Betters Regression in Query-based Multi-document Summarisation Techniques for Question Answering: Macquarie University at BioASQ7b
• Multi-Modal Generative Adversarial Network for Short Product Title Generation in Mobile E-Commerce
• VMSMO: Learning to Generate Multimodal Summary for Video-based News Articles
• Extracting Summary Knowledge Graphs from Long Documents
• Neural Sentence Ordering Based on Constraint Graphs
• A Closer Look at Data Bias in Neural Extractive Summarization Models
• Topic-aware Pointer-Generator Networks for Summarizing Spoken Conversations
• Optimizing the Factual Correctness of a Summary: A Study of Summarizing Radiology Reports
• Multi-document Summarization with Maximal Marginal Relevance-guided Reinforcement Learning
• Enhancing Extractive Text Summarization with Topic-Aware Graph Neural Networks
• Document Modeling with Graph Attention Networks for Multi-grained Machine Reading Comprehension
• LawSum: A weakly supervised approach for Indian Legal Document Summarization
• DeepChannel: Salience Estimation by Contrastive Learning for Extractive Document Summarization
• Self-Supervised Learning for Contextualized Extractive Summarization
• From Standard Summarization to New Tasks and Beyond: Summarization with Manifold Information
• AREDSUM: Adaptive Redundancy-Aware Iterative Sentence Ranking for Extractive Document Summarization
• Unsupervised Extractive Summarization using Pointwise Mutual Information
• Unsupervised Extractive Summarization by Pre-training Hierarchical Transformers
• CDEvalSumm: An Empirical Study of Cross-Dataset Evaluation for Neural Summarization Systems
• Abstractive Document Summarization without Parallel Data
• An Integrated Approach for Keyphrase Generation via Exploring the Power of Retrieval and Extraction
• Answering while Summarizing: Multi-task Learning for Multi-hop QA with Evidence Extraction
• LeafNATS: An Open-Source Toolkit and Live Demo System for Neural Abstractive Text Summarization
• The Style-Content Duality of Attractiveness: Learning to Write Eye-Catching Headlines via Disentanglement
• Dialogue Discourse-Aware Graph Model and Data Augmentation for Meeting Summarization
• Question Answering as an Automatic Evaluation Metric for News Article Summarization
• Product Title Refinement via Multi-Modal Generative Adversarial Learning
• Pre-training for Abstractive Document Summarization by Reinstating Source Text
• Improving the Similarity Measure of Determinantal Point Processes for Extractive Multi-Document Summarization
• Select and Attend: Towards Controllable Content Selection in Text Generation
• Joint Learning of Answer Selection and Answer Summary Generation in Community Question Answering
• Query-Focused EHR Summarization to Aid Imaging Diagnosis
• CSDS: A Fine-Grained Chinese Dataset for Customer Service Dialogue Summarization
• EASE: Extractive-Abstractive Summarization with Explanations
• Neural Learning of One-of-Many Solutions for Combinatorial Problems in Structured Output Spaces
• Latent Semantic Analysis Approach for Document Summarization Based on Word Embeddings
• Abstractive Text Summarization by Incorporating Reader Comments
• A more abstractive summarization model
• VT-SSum: A Benchmark Dataset for Video Transcript Segmentation and Summarization
• Automatic generation of reviews of scientific papers
• Conditional Neural Generation using Sub-Aspect Functions for Extractive News Summarization
• Contextualized Rewriting for Text Summarization
• On Generating Extended Summaries of Long Documents
• Artificial Intelligence Driven UAV-NOMA-MEC in Next Generation Wireless Networks
• Generating Rich Product Descriptions for Conversational E-commerce Systems
• Incorporating Question Answering-Based Signals into Abstractive Summarization via Salient Span Selection
• Improving Online Forums Summarization via Hierarchical Unified Deep Neural Network
• Discourse-Aware Unsupervised Summarization of Long Scientific Documents
• Unsupervised Summarization by Jointly Extracting Sentences and Keywords
• Topological Sort for Sentence Ordering
• An Effective Contextual Language Modeling Framework for Speech Summarization with Augmented Features
• Few-Shot Learning of an Interleaved Text Summarization Model by Pretraining with Synthetic Data
• Discriminative Pre-training for Low Resource Title Compression in Conversational Grocery
• How well do you know your summarization datasets?
• PodSumm -- Podcast Audio Summarization
• LenAtten: An Effective Length Controlling Unit For Text Summarization
• Multiple Instance Learning Networks for Fine-Grained Sentiment Analysis
• What Have We Achieved on Text Summarization?
• Knowledge-guided Unsupervised Rhetorical Parsing for Text Summarization
• Towards Supervised Extractive Text Summarization via RNN-based Sequence Classification
• Extractive Summarization of Long Documents by Combining Global and Local Context
• Clickbait? Sensational Headline Generation with Auto-tuned Reinforcement Learning
• Earlier Isn't Always Better: Sub-aspect Analysis on Corpus and System Biases in Summarization
• Guiding Extractive Summarization with Question-Answering Rewards
• Iterative Document Representation Learning Towards Summarization with Polishing
• Selective Attention Encoders by Syntactic Graph Convolutional Networks for Document Summarization
• Attend to the beginning: A study on using bidirectional attention for extractive summarization
• Review-Driven Answer Generation for Product-Related Questions in E-Commerce
• Bringing Structure into Summaries: a Faceted Summarization Dataset for Long Scientific Documents
• Goal-Driven Sequential Data Abstraction
• Facet-Aware Evaluation for Extractive Summarization
• Enhance Long Text Understanding via Distilled Gist Detector from Abstractive Summarization
• Fact-level Extractive Summarization with Hierarchical Graph Mask on BERT
• Extract with Order for Coherent Multi-Document Summarization
• CX DB8: A queryable extractive summarizer and semantic search engine
• Specificity-Based Sentence Ordering for Multi-Document Extractive Risk Summarization
• Topic-Guided Abstractive Multi-Document Summarization
• BERT4SO: Neural Sentence Ordering by Fine-tuning BERT
• Learning Sentence Embeddings for Coherence Modelling and Beyond
• CNewSum: A Large-scale Chinese News Summarization Dataset with Human-annotated Adequacy and Deducibility Level
• IndoSum: A New Benchmark Dataset for Indonesian Text Summarization
• The Rule of Three: Abstractive Text Summarization in Three Bullet Points
• Designing Multimodal Datasets for NLP Challenges
• Extractive Summarizer for Scholarly Articles
• Improving Abstractive Text Summarization with History Aggregation
• Attractive or Faithful? Popularity-Reinforced Learning for Inspired Headline Generation
• Ranking sentences from product description & bullets for better search
• MiRANews: Dataset and Benchmarks for Multi-Resource-Assisted News Summarization
• Generating an Overview Report over Many Documents
• Towards Explainable Fact Checking
• Controllable Neural Dialogue Summarization with Personal Named Entity Planning
• A Hierarchical Decoder with Three-level Hierarchical Attention to Generate Abstractive Summaries of Interleaved Texts
• Abstractive and mixed summarization for long-single documents
• A novel repetition normalized adversarial reward for headline generation
• TLDR9+: A Large Scale Resource for Extreme Summarization of Social Media Posts
• Latent Dirichlet Allocation with Residual Convolutional Neural Network Applied in Evaluating Credibility of Chinese Listed Companies
• Improving Graph-based Sentence Ordering with Iteratively Predicted Pairwise Orderings
• STRASS: A Light and Effective Method for Extractive Summarization Based on Sentence Embeddings
• SgSum: Transforming Multi-document Summarization into Sub-graph Selection
• An Unsupervised Semantic Sentence Ranking Scheme for Text Documents
• Abstractive Summarization Improved by WordNet-based Extractive Sentences
• Question-Aware Sentence Gating Networks for Question and Answering
• From web crawled text to project descriptions: automatic summarizing of social innovation projects
• Dialogue Inspectional Summarization with Factual Inconsistency Awareness
• A Generative Approach to Titling and Clustering Wikipedia Sections
• Using multiple ASR hypotheses to boost i18n NLU performance
• Transductive Learning for Abstractive News Summarization
• SupMMD: A Sentence Importance Model for Extractive Summarization using Maximum Mean Discrepancy
• Summary-Source Proposition-level Alignment: Task, Datasets and Supervised Baseline
• Semantic Extractor-Paraphraser based Abstractive Summarization
• INS: An Interactive Chinese News Synthesis System
• Towards Personalized and Human-in-the-Loop Document Summarization
• TWEETSUMM -- A Dialog Summarization Dataset for Customer Service
• Demoting the Lead Bias in News Summarization via Alternating Adversarial Learning
• Extractive Research Slide Generation Using Windowed Labeling Ranking
• Learning Syntactic and Dynamic Selective Encoding for Document Summarization
• DESCGEN: A Distantly Supervised Dataset for Generating Abstractive Entity Descriptions
• ScopeIt: Scoping Task Relevant Sentences in Documents
• Enhanced Seq2Seq Autoencoder via Contrastive Learning for Abstractive Text Summarization
• Read, Highlight and Summarize: A Hierarchical Neural Semantic Encoder-based Approach
• Learning to Summarize Passages: Mining Passage-Summary Pairs from Wikipedia Revision Histories
• How to Write Summaries with Patterns? Learning towards Abstractive Summarization through Prototype Editing
• Keeping Notes: Conditional Natural Language Generation with a Scratchpad Mechanism
• Multiplex Graph Neural Network for Extractive Text Summarization
• Medically Aware GPT-3 as a Data Generator for Medical Dialogue Summarization
• Countering the Effects of Lead Bias in News Summarization via Multi-Stage Training and Auxiliary Losses
• Generating summaries tailored to target characteristics
• Topic-Aware Contrastive Learning for Abstractive Dialogue Summarization