On the Use of ArXiv as a Dataset

Abstract

The arXiv has collected 1.5 million pre-print articles over 28 years, hosting literature from scientific fields including Physics, Mathematics, and Computer Science. Each pre-print features text, figures, authors, citations, categories, and other metadata. These rich, multi-modal features, combined with the natural graph structure---created by citation, affiliation, and co-authorship---makes the arXiv an exciting candidate for benchmarking next-generation models. Here we take the first necessary steps toward this goal, by providing a pipeline which standardizes and simplifies access to the arXiv's publicly available data. We use this pipeline to extract and analyze a 6.7 million edge citation graph, with an 11 billion word corpus of full-text research articles. We present some baseline classification results, and motivate application of more exciting generative graph models.

7 pages, 3 tables, 2 figures, ICLR 2019 workshop RLGM submission

References in corpus (3)

• Text Segmentation based on Semantic Word Embeddings
• Hierarchical network models for structured exchangeable interaction processes
• Predicting Research Trends From Arxiv

Cited by in corpus (6)

• Adaptive Neural Message Passing for Inductive Learning on Hypergraphs
• An agent-based model of interdisciplinary interactions in science
• SciXGen: A Scientific Paper Dataset for Context-Aware Text Generation
• MAIR: Framework for mining relationships between research articles, strategies, and regulations in the field of explainable artificial intelligence
• Subset Node Representation Learning over Large Dynamic Graphs
• Changepoint Analysis of Topic Proportions in Temporal Text Data