DziriBERT: a Pre-trained Language Model for the Algerian Dialect

Amine Abdaoui, Mohamed Berrimi, Mourad Oussalah +1

Pre-trained transformers are now the de facto models in Natural Language Processing given their state-of-the-art results in many tasks and languages. However, most of the current m…