347 citations · 1k across the 30 of their papers we have counts for
7 papers · 1 filter
CIVICS: Building a Dataset for Examining Culturally-Informed Values in Large Language Models
Giada Pistilli, Alina Leidinger, Yacine Jernite +3
This paper introduces the "CIVICS: Culturally-Informed & Values-Inclusive Corpus for Societal impacts" dataset, designed to evaluate the social and cultural variation of Large Lang…
Position: Key Claims in LLM Research Have a Long Tail of Footnotes
Anna Rogers, Alexandra Sasha Luccioni
Much of the recent discourse within the ML community has been centered around Large Language Models (LLMs), their functionality and potential -- yet not only do we not have a worki…
The ROOTS Search Tool: Data Transparency for LLMs
Aleksandra Piktus, Christopher Akiki, Paulo Villegas +5
ROOTS is a 1.6TB multilingual text corpus developed for the training of BLOOM, currently the largest language model explicitly accompanied by commensurate data governance efforts.…
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
BigScience Workshop, :, Teven Le Scao +391
Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to wi…
Ensuring the Inclusive Use of Natural Language Processing in the Global Response to COVID-19
Alexandra Sasha Luccioni, Katherine Hoffmann Pham, Cynthia Sin Nga Lam +2
Natural language processing (NLP) plays a significant role in tools for the COVID-19 pandemic response, from detecting misinformation on social media to helping to provide accurate…
What's in the Box? A Preliminary Analysis of Undesirable Content in the Common Crawl Corpus
Alexandra Sasha Luccioni, Joseph D. Viviano
Whereas much of the success of the current generation of neural language models has been driven by increasingly large training corpora, relatively little research has been dedicate…