27 citations · 42 across the 2 of their papers we have counts for
3 papers
cs.CL2020★ 15 cited
AraGPT2: Pre-Trained Transformer for Arabic Language Generation
Wissam Antoun, Fady Baly, Hazem Hajj
Recently, pre-trained transformer-based architectures have proven to be very efficient at language modeling and understanding, given that they are trained on a large enough corpus.…
cs.CL2020★ 27 cited
AraELECTRA: Pre-Training Text Discriminators for Arabic Language Understanding
Wissam Antoun, Fady Baly, Hazem Hajj
Advances in English language representation enabled a more sample-efficient pre-training task by Efficiently Learning an Encoder that Classifies Token Replacements Accurately (ELEC…
cs.CL2020
AraBERT: Transformer-based Model for Arabic Language Understanding
Wissam Antoun, Fady Baly, Hazem Hajj
The Arabic language is a morphologically rich language with relatively few resources and a less explored syntax compared to English. Given these limitations, Arabic Natural Languag…