3 citations · 10 across the 12 of their papers we have counts for
1 paper · 1 filter
Léo Dana, Muni Sreenivas Pydi, Yann Chevaleyre
Recent research has explored the memorization capacity of multi-head attention, but these findings are constrained by unrealistic limitations on the context size. We present a nove…