A General Approach for Predicting the Behavior of the Supreme Court of the United States
arXiv:1612.03473 · doi:10.1371/journal.pone.0174698
Abstract
Building on developments in machine learning and prior work in the science of judicial prediction, we construct a model designed to predict the behavior of the Supreme Court of the United States in a generalized, out-of-sample context. To do so, we develop a time evolving random forest classifier which leverages some unique feature engineering to predict more than 240,000 justice votes and 28,000 cases outcomes over nearly two centuries (1816-2015). Using only data available prior to decision, our model outperforms null (baseline) models at both the justice and case level under both parametric and non-parametric tests. Over nearly two centuries, we achieve 70.2% accuracy at the case outcome level and 71.9% at the justice vote level. More recently, over the past century, we outperform an in-sample optimized null model by nearly 5%. Our performance is consistent with, and improves on the general level of prediction demonstrated by prior work; however, our model is distinctive because it can be applied out-of-sample to the entire past and future of the Court, not a single term. Our results represent an important advance for the science of quantitative legal prediction and portend a range of other potential applications.
version 2.02; 18 pages, 5 figures. This paper is related to but distinct from arXiv:1407.6333, and the results herein supersede arXiv:1407.6333. Source code available at https://github.com/mjbommar/scotus-predict-v2
References in corpus (6)
- Scikit-learn: Machine Learning in Python
- A General Approach for Predicting the Behavior of the Supreme Court of the United States
- Large-scale structure of time evolving citation networks
- Statistical mechanics of the US Supreme Court
- Justice blocks and predictability of US Supreme Court votes
- Predicting the Behavior of the Supreme Court of the United States: A General Approach
Cited by in corpus (19)
- On the Opportunities and Risks of Foundation Models
- A General Approach for Predicting the Behavior of the Supreme Court of the United States
- Predicting and Understanding Law-Making with Word Vectors and an Ensemble Model
- SECaps: A Sequence Enhanced Capsule Model for Charge Prediction
- Automatic Judgment Prediction via Legal Reading Comprehension
- Japanese Tort-case Dataset for Rationale-supported Legal Judgment Prediction
- Discovering Significant Topics from Legal Decisions with Selective Inference
- Authorized and Unauthorized Practices of Law: The Role of Autonomous Levels of AI Legal Reasoning
- Immigration Document Classification and Automated Response Generation
- Legal Judgment Prediction (LJP) Amid the Advent of Autonomous AI Legal Reasoning
- European Court of Human Right Open Data project
- Law on the Market? Abnormal Stock Returns and Supreme Court Decision-Making
- Spatial analysis of U.S. Supreme Court 5-to-4 decisions
- How Predictable is Your State? Leveraging Lexical and Contextual Information for Predicting Legislative Floor Action at the State Level
- AI Literacy for Legal AI Systems: A practical approach
- Online publication of court records: circumventing the privacy-transparency trade-off
- An Ontological AI-and-Law Framework for the Autonomous Levels of AI Legal Reasoning
- Strong consensus on US Supreme Court spans a century
- Computational geometry and the U.S. Supreme Court