500 citations · 1.4k across the 23 of their papers we have counts for
1 paper · 1 filter
Junxiong Wang, Jing Nathan Yan, Albert Gu +1
Transformers have been essential to pretraining success in NLP. While other architectures have been used, downstream accuracy is either significantly worse, or requires attention l…