5 citations · 8 across the 3 of their papers we have counts for
3 papers
cs.CL2021★ 1 cited
No News is Good News: A Critique of the One Billion Word Benchmark
Helen Ngo, João G. M. Araújo, Jeffrey Hui +1
The One Billion Word Benchmark is a dataset derived from the WMT 2011 News Crawl, commonly used to measure language modeling ability in natural language processing. We train models…
cs.CL2021★ 2 cited
Mitigating harm in language models with conditional-likelihood filtration
Helen Ngo, Cooper Raterink, João G. M. Araújo +4
Language models trained on large-scale unfiltered datasets curated from the open web acquire systemic biases, prejudices, and harmful views from their training data. We present a m…
cs.LG2020★ 5 cited
Interlocking Backpropagation: Improving depthwise model-parallelism
Aidan N. Gomez, Oscar Key, Kuba Perlin +4
The number of parameters in state of the art neural networks has drastically increased in recent years. This surge of interest in large scale neural networks has motivated the deve…