558 citations · 3.6k across the 65 of their papers we have counts for
Showing 2021 · cs.CLShow all
2 papers · 2 filters
cs.CL2021★ 4 cited
Are Larger Pretrained Language Models Uniformly Better? Comparing Performance at the Instance Level
Ruiqi Zhong, Dhruba Ghosh, Dan Klein +1
Larger language models have higher accuracy on average, but are they better on every single instance (datapoint)? Some work suggests larger models have higher out-of-distribution r…
cs.CL2021★ 2 cited
Approximating How Single Head Attention Learns
Charlie Snell, Ruiqi Zhong, Dan Klein +1
Why do models often attend to salient words, and how does this evolve throughout training? We approximate model training as a two stage process: early on in training when the atten…