Rethinking Pairwise Token Interaction in Spiking Transformers

Sicheng Shen, Dongcheng Zhao, Zhiyuan Li +5

Spiking Transformers inherit token interaction mechanisms from conventional Transformers, yet their sparse binary representations fundamentally alter how token-to-token communicati…