1 paper
Léa Bohbot, Cyril Letrouit, Gabriel Peyré +1
As context windows in large language models continue to expand, it is essential to characterize how attention behaves at extreme sequence lengths. We introduce token sample complex…