Publications (9)
Towards a Transformer-Based Pre-trained Model for IoT Traffic Classification
Bruna Bazaluk, Mosab Hamdan, Mustafa Ghaleb +3
The classification of IoT traffic is important to improve the efficiency and security of IoT-based networks. As the state-of-the-art classification methods are based on Deep Learni…
Masader: Metadata Sourcing for Arabic Text and Speech Data Resources
Zaid Alyafeai, Maraim Masoud, Mustafa Ghaleb +1
The NLP pipeline has evolved dramatically in the last few years. The first step in the pipeline is to find suitable annotated datasets to evaluate the tasks we are trying to solve.…
CIDAR: Culturally Relevant Instruction Dataset For Arabic
Zaid Alyafeai, Khalid Almubarak, Ahmed Ashraf +9
Instruction tuning has emerged as a prominent methodology for teaching Large Language Models (LLMs) to follow instructions. However, current instruction datasets predominantly cate…
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
BigScience Workshop, :, Teven Le Scao +391
Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to wi…
Evaluating Various Tokenizers for Arabic Text Classification
Zaid Alyafeai, Maged S. Al-shaibani, Mustafa Ghaleb +1
The first step in any NLP pipeline is to split the text into individual tokens. The most obvious and straightforward approach is to use words as tokens. However, given a large text…
Masader Plus: A New Interface for Exploring +500 Arabic NLP Datasets
Yousef Altaher, Ali Fadel, Mazen Alotaibi +18
Masader (Alyafeai et al., 2021) created a metadata structure to be used for cataloguing Arabic NLP datasets. However, developing an easy way to explore such a catalogue is a challe…
Federated Testing (FedTest): A New Scheme to Enhance Convergence and Mitigate Adversarial Attacks in Federating Learning
Mustafa Ghaleb, Mohanad Obeed, Muhamad Felemban +2
Federated Learning (FL) has emerged as a significant paradigm for training machine learning models. This is due to its data-privacy-preserving property and its efficient exploitati…
Calliar: An Online Handwritten Dataset for Arabic Calligraphy
Zaid Alyafeai, Maged S. Al-shaibani, Mustafa Ghaleb +1
Calligraphy is an essential part of the Arabic heritage and culture. It has been used in the past for the decoration of houses and mosques. Usually, such calligraphy is designed ma…
File Fragment Classification using Light-Weight Convolutional Neural Networks
Mustafa Ghaleb, Kunwar Saaim, Muhamad Felemban +2
In digital forensics, file fragment classification is an important step toward completing file carving process. There exist several techniques to identify the type of file fragment…