Characterizing Narrative Content in Web-scale LLM Pretraining Data

Teagan Johnson, Elliott Ash, Andrew Piper +1

The narrative composition of web-scale LLM pretraining corpora remains largely unexplored even though narrative is a fundamental mode of human communication. We present the first f…