1 paper
Yuma Ichikawa, Naoya Takagi, Takumi Nakagawa +2
Transformers operate as horizontal token-by-token scanners; at each generation step, attending to an ever-growing sequence of token-level states. This access pattern increases pref…