Legal Document Classification: An Application to Law Area Prediction of Petitions to Public Prosecution Service

Abstract

In recent years, there has been an increased interest in the application of Natural Language Processing (NLP) to legal documents. The use of convolutional and recurrent neural networks along with word embedding techniques have presented promising results when applied to textual classification problems, such as sentiment analysis and topic segmentation of documents. This paper proposes the use of NLP techniques for textual classification, with the purpose of categorizing the descriptions of the services provided by the Public Prosecutor's Office of the State of Paraná to the population in one of the areas of law covered by the institution. Our main goal is to automate the process of assigning petitions to their respective areas of law, with a consequent reduction in costs and time associated with such process while allowing the allocation of human resources to more complex tasks. In this paper, we compare different approaches to word representations in the aforementioned task: including document-term matrices and a few different word embeddings. With regards to the classification models, we evaluated three different families: linear models, boosted trees and neural networks. The best results were obtained with a combination of Word2Vec trained on a domain-specific corpus and a Recurrent Neural Network (RNN) architecture (more specifically, LSTM), leading to an accuracy of 90\% and F1-Score of 85\% in the classification of eighteen categories (law areas).

References in corpus (7)

• Distributed Representations of Words and Phrases and their Compositionality
• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• Comparative Study of CNN and RNN for Natural Language Processing
• "What is Relevant in a Text Document?": An Interpretable Machine Learning Approach
• Exploring the Use of Text Classification in the Legal Domain
• Portuguese Word Embeddings: Evaluating on Word Analogies and Natural Language Tasks
• The Expressive Power of Word Embeddings

Cited by in corpus (1)

• A Small Claims Court for the NLP: Judging Legal Text Classification Strategies With Small Datasets