189 citations · 197 across the 4 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CL2021★ 1 cited
No News is Good News: A Critique of the One Billion Word Benchmark
Helen Ngo, João G. M. Araújo, Jeffrey Hui +1
The One Billion Word Benchmark is a dataset derived from the WMT 2011 News Crawl, commonly used to measure language modeling ability in natural language processing. We train models…
cs.CL2021★ 2 cited
Mitigating harm in language models with conditional-likelihood filtration
Helen Ngo, Cooper Raterink, João G. M. Araújo +4
Language models trained on large-scale unfiltered datasets curated from the open web acquire systemic biases, prejudices, and harmful views from their training data. We present a m…