178 citations · 455 across the 19 of their papers we have counts for
4 papers · 1 filter
Layer-wise Guided Training for BERT: Learning Incrementally Refined Document Representations
Nikolaos Manginas, Ilias Chalkidis, Prodromos Malakasiotis
Although BERT is widely used by the NLP community, little is known about its inner workings. Several attempts have been made to shed light on certain aspects of BERT, often with co…
LEGAL-BERT: The Muppets straight out of Law School
Ilias Chalkidis, Manos Fergadiotis, Prodromos Malakasiotis +2
BERT has achieved impressive performance in several NLP tasks. However, there has been limited investigation on its adaptation guidelines in specialised domains. Here we focus on t…
An Empirical Study on Large-Scale Multi-Label Text Classification Including Few and Zero-Shot Labels
Ilias Chalkidis, Manos Fergadiotis, Sotiris Kotitsas +3
Large-scale Multi-label Text Classification (LMTC) has a wide range of Natural Language Processing (NLP) applications and presents interesting challenges. First, not all labels are…
GREEK-BERT: The Greeks visiting Sesame Street
John Koutsikakis, Ilias Chalkidis, Prodromos Malakasiotis +1
Transformer-based language models, such as BERT and its variants, have achieved state-of-the-art performance in several downstream natural language processing (NLP) tasks on generi…