activity
20212025
most citedStarCoder: may the source be with you!

200 citations · 398 across the 15 of their papers we have counts for

collaborators
Showing 2023Show all

9 papers · 1 filter

cs.CL2023

BLESS: Benchmarking Large Language Models on Sentence Simplification

Tannon Kew, Alison Chi, Laura Vásquez-Rodríguez +4

We present BLESS, a comprehensive performance benchmark of the most recent state-of-the-art large language models (LLMs) on the task of text simplification (TS). We examine how wel…

cs.CL2023

GAIA Search: Hugging Face and Pyserini Interoperability for NLP Training Data Exploration

Aleksandra Piktus, Odunayo Ogundepo, Christopher Akiki +6

Noticing the urgent need to provide tools for fast and user-friendly qualitative analysis of large-scale textual corpora of the modern NLP, we propose to turn to the mature and wel…

cs.CL2023★ 200 cited

StarCoder: may the source be with you!

Raymond Li, Loubna Ben Allal, Yangtian Zi +64

The BigCode community, an open-scientific collaboration working on the responsible development of Large Language Models for Code (Code LLMs), introduces StarCoder and StarCoderBase…

cs.CL2023★ 65 cited

The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset

Hugo Laurençon, Lucile Saulnier, Thomas Wang +51

As language models grow ever larger, the need for large-scale high-quality text datasets has never been more pressing, especially in multilingual settings. The BigScience workshop,…

cs.CY2023★ 56 cited

Stable Bias: Analyzing Societal Representations in Diffusion Models

Alexandra Sasha Luccioni, Christopher Akiki, Margaret Mitchell +1

As machine learning-enabled Text-to-Image (TTI) systems are becoming increasingly prevalent and seeing growing adoption as commercial services, characterizing the social biases the…

cs.CL2023

The ROOTS Search Tool: Data Transparency for LLMs

Aleksandra Piktus, Christopher Akiki, Paulo Villegas +5

ROOTS is a 1.6TB multilingual text corpus developed for the training of BLOOM, currently the largest language model explicitly accompanied by commensurate data governance efforts.…

cs.SE2023★ 54 cited

SantaCoder: don't reach for the stars!

Loubna Ben Allal, Raymond Li, Denis Kocetkov +38

The BigCode project is an open-scientific collaboration working on the responsible development of large language models for code. This tech report describes the progress of the col…

cs.IR2023★ 1 cited

Spacerini: Plug-and-play Search Engines with Pyserini and Hugging Face

Christopher Akiki, Odunayo Ogundepo, Aleksandra Piktus +4

We present Spacerini, a tool that integrates the Pyserini toolkit for reproducible information retrieval research with Hugging Face to enable the seamless construction and deployme…

cs.CY2023★ 11 cited

Towards Openness Beyond Open Access: User Journeys through 3 Open AI Collaboratives

Jennifer Ding, Christopher Akiki, Yacine Jernite +2

Open Artificial Intelligence (Open source AI) collaboratives offer alternative pathways for how AI can be developed beyond well-resourced technology companies and who can be a part…