LegaLMFiT: Efficient Short Legal Text Classification with LSTM Language Model Pre-Training

Benjamin Clavié, Akshita Gheewala, Paul Briton +3

Large Transformer-based language models such as BERT have led to broad performance improvements on many NLP tasks. Domain-specific variants of these models have demonstrated excell…