161 citations · 373 across the 13 of their papers we have counts for
4 papers · 1 filter
Position: Key Claims in LLM Research Have a Long Tail of Footnotes
Anna Rogers, Alexandra Sasha Luccioni
Much of the recent discourse within the ML community has been centered around Large Language Models (LLMs), their functionality and potential -- yet not only do we not have a worki…
Using Sequences of Life-events to Predict Human Lives
Germans Savcisens, Tina Eliassi-Rad, Lars Kai Hansen +5
Over the past decade, machine learning has revolutionized computers' ability to analyze text through flexible computational models. Due to their structural similarity to written la…
The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset
Hugo Laurençon, Lucile Saulnier, Thomas Wang +51
As language models grow ever larger, the need for large-scale high-quality text datasets has never been more pressing, especially in multilingual settings. The BigScience workshop,…
The ROOTS Search Tool: Data Transparency for LLMs
Aleksandra Piktus, Christopher Akiki, Paulo Villegas +5
ROOTS is a 1.6TB multilingual text corpus developed for the training of BLOOM, currently the largest language model explicitly accompanied by commensurate data governance efforts.…