197 citations · 446 across the 15 of their papers we have counts for
1 paper · 1 filter
Jeremiah Milbauer, Annie Louis, Mohammad Javad Hosseini +3
Transformer encoders contextualize token representations by attending to all other tokens at each layer, leading to quadratic increase in compute effort with the input length. In p…