What is Wrong with Language Models that Can Not Tell a Story?
arXiv:2211.05044 · doi:10.18653/v1/2023.wnu-1.8
Abstract
This paper argues that a deeper understanding of narrative and the successful generation of longer subjectively interesting texts is a vital bottleneck that hinders the progress in modern Natural Language Processing (NLP) and may even be in the whole field of Artificial Intelligence. We demonstrate that there are no adequate datasets, evaluation methods, and even operational concepts that could be used to start working on narrative processing.
References in corpus (7)
- PaLM: Scaling Language Modeling with Pathways
- Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language
- Pretrained Transformers as Universal Computation Engines
- METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals
- Semantic Exploration from Language Abstractions and Pretrained Representations
- DYPLODOC: Dynamic Plots for Document Classification
- Towards a Formal Model of Narratives