343 citations · 355 across the 10 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.CL2022★ 1 cited
A Continuum of Generation Tasks for Investigating Length Bias and Degenerate Repetition
Darcey Riley, David Chiang
Language models suffer from various degenerate behaviors. These differ between tasks: machine translation (MT) exhibits length bias, while tasks like story generation exhibit exces…
cs.LG2022★ 2 cited
Overcoming a Theoretical Limitation of Self-Attention
David Chiang, Peter Cholak
Although transformers are remarkably effective for many tasks, there are some surprisingly easy-looking regular languages that they struggle with. Hahn shows that for languages whe…