13 citations · 35 across the 15 of their papers we have counts for
1 paper · 1 filter
Clayton Sanford, Daniel Hsu, Matus Telgarsky
Attention layers, as commonly used in transformers, form the backbone of modern deep learning, yet there is no mathematical description of their benefits and deficiencies as compar…