157 citations · 371 across the 9 of their papers we have counts for
3 papers · 1 filter
The Falcon Series of Open Language Models
Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi +11
We introduce the Falcon series: 7B, 40B, and 180B parameters causal decoder-only models trained on a diverse high-quality corpora predominantly assembled from web data. The largest…
The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only
Guilherme Penedo, Quentin Malartic, Daniel Hesslow +6
Large language models are commonly trained on a mixture of filtered web data and curated high-quality corpora, such as social media conversations, books, or technical papers. This…
Linear Optical Random Projections Without Holography
Ruben Ohana, Daniel Hesslow, Daniel Brunner +2
We introduce a novel method to perform linear optical random projections without the need for holography. Our method consists of a computationally trivial combination of multiple i…