WikiAtomicEdits: A Multilingual Corpus of Wikipedia Edits for Modeling Language and Discourse
arXiv:1808.09422
Abstract
We release a corpus of 43 million atomic edits across 8 languages. These edits are mined from Wikipedia edit history and consist of instances in which a human editor has inserted a single contiguous phrase into, or deleted a single contiguous phrase from, an existing sentence. We use the collected data to show that the language generated during editing differs from the language that we observe in standard corpora, and that models trained on edits encode different aspects of semantics and discourse than models trained on raw, unstructured text. We release the full corpus as a resource to aid ongoing research in semantics, discourse, and representation learning.
References in corpus (6)
- Sequence to Sequence Learning with Neural Networks
- Learned in Translation: Contextualized Word Vectors
- For the sake of simplicity: Unsupervised extraction of lexical simplifications from Wikipedia
- DisSent: Sentence Representation Learning from Explicit Discourse Relations
- Governance in Social Media: A case study of the Wikipedia promotion process
- A Corpus of Sentence-level Revisions in Academic Writing: A Step towards Understanding Statement Strength in Communication