activity
20202026
most citedALP-KD: Attention-Based Layer Projection for Knowledge Distillation

8 citations · 23 across the 6 of their papers we have counts for

collaborators
Showing 2023Show all

1 paper · 1 filter

cs.CL2023

AraMUS: Pushing the Limits of Data and Model Scale for Arabic Natural Language Processing

Asaad Alghamdi, Xinyu Duan, Wei Jiang +9

Developing monolingual large Pre-trained Language Models (PLMs) is shown to be very successful in handling different tasks in Natural Language Processing (NLP). In this work, we pr…