7 citations · 23 across the 8 of their papers we have counts for
1 paper · 1 filter
Swetha Mandava, Szymon Migacz, Alex Fit Florea
Transformer-based models consist of interleaved feed-forward blocks - that capture content meaning, and relatively more expensive self-attention blocks - that capture context meani…