PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Tracking
arXiv:2004.14967
Abstract
We propose the task of outline-conditioned story generation: given an outline as a set of phrases that describe key characters and events to appear in a story, the task is to generate a coherent narrative that is consistent with the provided outline. This task is challenging as the input only provides a rough sketch of the plot, and thus, models need to generate a story by interweaving the key points provided in the outline. This requires the model to keep track of the dynamic states of the latent plot, conditioning on the input outline while generating the full story. We present PlotMachines, a neural narrative model that learns to transform an outline into a coherent story by tracking the dynamic plot states. In addition, we enrich PlotMachines with high-level discourse structure so that the model can learn different writing styles corresponding to different parts of the narrative. Comprehensive experiments over three fiction and non-fiction datasets demonstrate that large-scale language models, such as GPT-2 and Grover, despite their impressive generation performance, are not sufficient in generating coherent narratives for the given outline, and dynamic plot state tracking is important for composing narratives with tighter, more consistent plots.
arXiv commentEMNLP 2020
References in corpus (8)
- The Curious Case of Neural Text Degeneration
- CTRL: A Conditional Transformer Language Model for Controllable Generation
- End-To-End Memory Networks
- Narrative Planning: Balancing Plot and Character
- Tracking the World State with Recurrent Entity Networks
- Controllable Neural Story Plot Generation via Reward Shaping
- Story Generation from Sequence of Independent Short Descriptions
- Chinese Poetry Generation with Planning based Neural Network
Cited by in corpus (14)
- Evaluation of Text Generation: A Survey
- StoryDB: Broad Multi-language Narrative Dataset
- proScript: Partially Ordered Scripts Generation via Pre-trained Language Models
- Automatic Story Generation: Challenges and Attempts
- Outline to Story: Fine-grained Controllable Story Generation from Cascaded Events
- Progressive Generation of Long Text with Pretrained Language Models
- Inferring the Reader: Guiding Automated Story Generation with Commonsense Reasoning
- Conditional Generation of Temporally-ordered Event Sequences
- Plug-and-Blend: A Framework for Controllable Story Generation with Blended Control Codes
- IGA : An Intent-Guided Authoring Assistant
- WikiTableT: A Large-Scale Data-to-Text Dataset for Generating Wikipedia Article Sections
- DiSCoL: Toward Engaging Dialogue Systems through Conversational Line Guided Response Generation
- InFillmore: Frame-Guided Language Generation with Bidirectional Context
- Plot-guided Adversarial Example Construction for Evaluating Open-domain Story Generation