2 papers
cs.NE2026
Rethinking Pairwise Token Interaction in Spiking Transformers
Sicheng Shen, Dongcheng Zhao, Zhiyuan Li +5
Spiking Transformers inherit token interaction mechanisms from conventional Transformers, yet their sparse binary representations fundamentally alter how token-to-token communicati…
cs.NE2026
Spiking Local Interaction and Adaptive Complementary Fusion for Spiking Transformer
Dongcheng Zhao, Sicheng Shen, Zhenyu Yang +6
Spiking Transformers model token interactions primarily through spiking self-attention (SSA). However, binary query and key representations map continuous similarities to sparse an…