activity
20182026
most citedThe RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only

157 citations · 334 across the 8 of their papers we have counts for

collaborators
Showing 2023Show all

6 papers · 1 filter

cs.CL2023★ 117 cited

The Falcon Series of Open Language Models

Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi +11

We introduce the Falcon series: 7B, 40B, and 180B parameters causal decoder-only models trained on a diverse high-quality corpora predominantly assembled from web data. The largest…

cs.CV2023

Do VSR Models Generalize Beyond LRS3?

Yasser Abdelaziz Dahou Djilali, Sanath Narayan, Eustache Le Bihan +3

The Lip Reading Sentences-3 (LRS3) benchmark has primarily been the focus of intense research in visual speech recognition (VSR) during the last few years. As a result, there is an…

cs.LG2023★ 1 cited

Emergent Communication in Multi-Agent Reinforcement Learning for Future Wireless Networks

Marwa Chafii, Salmane Naoumi, Reda Alami +3

In different wireless network scenarios, multiple network entities need to cooperate in order to achieve a common task with minimum delay and energy consumption. Future wireless ne…

eess.SP2023★ 1 cited

Joint Semantic-Native Communication and Inference via Minimal Simplicial Structures

Qiyang Zhao, Hang Zou, Mehdi Bennis +3

In this work, we study the problem of semantic communication and inference, in which a student agent (i.e. mobile device) queries a teacher agent (i.e. cloud sever) to generate hig…

cs.CL2023★ 157 cited

The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only

Guilherme Penedo, Quentin Malartic, Daniel Hesslow +6

Large language models are commonly trained on a mixture of filtered web data and curated high-quality corpora, such as social media conversations, books, or technical papers. This…

cs.LG2023★ 28 cited

A Comprehensive Review and a Taxonomy of Edge Machine Learning: Requirements, Paradigms, and Techniques

Wenbin Li, Hakim Hacid, Ebtesam Almazrouei +1

The union of Edge Computing (EC) and Artificial Intelligence (AI) has brought forward the Edge AI concept to provide intelligent solutions close to the end-user environment, for pr…