16 citations · 66 across the 13 of their papers we have counts for
1 paper · 2 filters
Clayton Sanford, Daniel Hsu, Matus Telgarsky
Attention layers, as commonly used in transformers, form the backbone of modern deep learning, yet there is no mathematical description of their benefits and deficiencies as compar…