86 citations · 126 across the 9 of their papers we have counts for
14 papers · 1 filter
Legal-Tech Open Diaries: Lesson learned on how to develop and deploy light-weight models in the era of humongous Language Models
Stelios Maroudas, Sotiris Legkas, Prodromos Malakasiotis +1
In the era of billion-parameter-sized Language Models (LMs), start-ups have to follow trends and adapt their technology accordingly. Nonetheless, there are open challenges since th…
An Exploration of Hierarchical Attention Transformers for Efficient Long Document Classification
Ilias Chalkidis, Xiang Dai, Manos Fergadiotis +2
Non-hierarchical sparse attention Transformer-based models, such as Longformer and Big Bird, are popular approaches to working with long documents. There are clear benefits to thes…
Data Augmentation for Biomedical Factoid Question Answering
Dimitris Pappas, Prodromos Malakasiotis, Ion Androutsopoulos
We study the effect of seven data augmentation (da) methods in factoid question answering, focusing on the biomedical domain, where obtaining training instances is particularly dif…
Paragraph-level Rationale Extraction through Regularization: A case study on European Court of Human Rights Cases
Ilias Chalkidis, Manos Fergadiotis, Dimitrios Tsarapatsanis +3
Interpretability or explainability is an emerging research field in NLP. From a user-centric point of view, the goal is to build models that provide proper justification for their…
Neural Contract Element Extraction Revisited: Letters from Sesame Street
Ilias Chalkidis, Manos Fergadiotis, Prodromos Malakasiotis +1
We investigate contract element extraction. We show that LSTM-based encoders perform better than dilated CNNs, Transformers, and BERT in this task. We also find that domain-specifi…
Regulatory Compliance through Doc2Doc Information Retrieval: A case study in EU/UK legislation where text similarity has limitations
Ilias Chalkidis, Manos Fergadiotis, Nikolaos Manginas +2
Major scandals in corporate history have urged the need for regulatory compliance, where organizations need to ensure that their controls (processes) comply with relevant laws, reg…