565 citations · 1.8k across the 14 of their papers we have counts for
Showing 2021Show all
3 papers · 1 filter
cs.CL2021
Cut the CARP: Fishing for zero-shot story evaluation
Shahbuland Matiana, JR Smith, Ryan Teehan +4
Recent advances in large-scale language models (Raffel et al., 2019; Brown et al., 2020) have brought significant qualitative and quantitative improvements in machine-driven text g…
cs.CL2021★ 2 cited
An Empirical Exploration in Quality Filtering of Text Data
Leo Gao
While conventional wisdom suggests that more aggressively filtering data from low-quality sources like Common Crawl always monotonically improves the quality of training data, we f…
cs.LG2021★ 563 cited
Multitask Prompted Training Enables Zero-Shot Task Generalization
Victor Sanh, Albert Webson, Colin Raffel +38
Large language models have recently been shown to attain reasonable zero-shot generalization on a diverse set of tasks (Brown et al., 2020). It has been hypothesized that this is a…