PyEuroVoc: A Tool for Multilingual Legal Document Classification with EuroVoc Descriptors
arXiv:2108.01139
Abstract
EuroVoc is a multilingual thesaurus that was built for organizing the legislative documentary of the European Union institutions. It contains thousands of categories at different levels of specificity and its descriptors are targeted by legal texts in almost thirty languages. In this work we propose a unified framework for EuroVoc classification on 22 languages by fine-tuning modern Transformer-based pretrained language models. We study extensively the performance of our trained models and show that they significantly improve the results obtained by a similar tool - JEX - on the same dataset. The code and the fine-tuned models were open sourced, together with a programmatic interface that eases the process of loading the weights of a trained model and of classifying a new document.
RANLP2021
References in corpus (9)
- Distilling the Knowledge in a Neural Network
- Natural Language Processing (almost) from Scratch
- On the difficulty of training Recurrent Neural Networks
- BERTje: A Dutch BERT Model
- Multilingual is not enough: BERT for Finnish
- GREEK-BERT: The Greeks visiting Sesame Street
- Automatic annotation of multilingual text collections with a conceptual thesaurus
- Playing with Words at the National Library of Sweden -- Making a Swedish BERT
- WikiBERT models: deep transfer learning for many languages