activity
20182026
most citedThe RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only

157 citations · 334 across the 8 of their papers we have counts for

collaborators

8 papers

cs.CL2026★ 22 cited

A Holistic Assessment of the Carbon Footprint of Noor, a Very Large Arabic Language Model

Imad Lakim, Ebtesam Almazrouei, Ibrahim Abu Alhaol +2

As ever larger language models grow more ubiquitous, it is crucial to consider their environmental impact. Characterised by extreme size and resource use, recent generations of mod…

cs.CL2023★ 117 cited

The Falcon Series of Open Language Models

Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi +11

We introduce the Falcon series: 7B, 40B, and 180B parameters causal decoder-only models trained on a diverse high-quality corpora predominantly assembled from web data. The largest…

cs.CV2023

Do VSR Models Generalize Beyond LRS3?

Yasser Abdelaziz Dahou Djilali, Sanath Narayan, Eustache Le Bihan +3

The Lip Reading Sentences-3 (LRS3) benchmark has primarily been the focus of intense research in visual speech recognition (VSR) during the last few years. As a result, there is an…

cs.LG2023★ 1 cited

Emergent Communication in Multi-Agent Reinforcement Learning for Future Wireless Networks

Marwa Chafii, Salmane Naoumi, Reda Alami +3

In different wireless network scenarios, multiple network entities need to cooperate in order to achieve a common task with minimum delay and energy consumption. Future wireless ne…

eess.SP2023★ 1 cited

Joint Semantic-Native Communication and Inference via Minimal Simplicial Structures

Qiyang Zhao, Hang Zou, Mehdi Bennis +3

In this work, we study the problem of semantic communication and inference, in which a student agent (i.e. mobile device) queries a teacher agent (i.e. cloud sever) to generate hig…

cs.CL2023★ 157 cited

The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only

Guilherme Penedo, Quentin Malartic, Daniel Hesslow +6

Large language models are commonly trained on a mixture of filtered web data and curated high-quality corpora, such as social media conversations, books, or technical papers. This…

cs.LG2023★ 28 cited

A Comprehensive Review and a Taxonomy of Edge Machine Learning: Requirements, Paradigms, and Techniques

Wenbin Li, Hakim Hacid, Ebtesam Almazrouei +1

The union of Edge Computing (EC) and Artificial Intelligence (AI) has brought forward the Edge AI concept to provide intelligent solutions close to the end-user environment, for pr…

cs.ET2018★ 8 cited

Internet of NanoThings: Concepts and Applications

Ebtesam Almazrouei, Raed M. Shubair, Fabrice Saffre

This chapter focuses on Internet of Things from the nanoscale point of view. The chapter starts with section 1 which provides an introduction of nanothings and nanotechnologies. Th…