Spiking Local Interaction and Adaptive Complementary Fusion for Spiking Transformer

Dongcheng Zhao, Sicheng Shen, Zhenyu Yang +6

Spiking Transformers model token interactions primarily through spiking self-attention (SSA). However, binary query and key representations map continuous similarities to sparse an…