4 papers
TP-Spikformer: Token Pruned Spiking Transformer
Wenjie Wei, Xiaolong Zhou, Malu Zhang +8
Spiking neural networks (SNNs) offer an energy-efficient alternative to traditional neural networks due to their event-driven computing paradigm. However, recent advancements in sp…
Training-Free ANN-to-SNN Conversion for High-Performance Spiking Transformer
Jingya Wang, Xin Deng, Wenjie Wei +7
Leveraging the event-driven paradigm, Spiking Neural Networks (SNNs) offer a promising approach for energy-efficient Transformer architectures.While ANN-to-SNN conversion avoids th…
Unveiling the Spatial-temporal Effective Receptive Fields of Spiking Neural Networks
Jieyuan Zhang, Xiaolong Zhou, Shuai Wang +6
Spiking Neural Networks (SNNs) demonstrate significant potential for energy-efficient neuromorphic computing through an event-driven paradigm. While training methods and computatio…
Spiking Vision Transformer with Saccadic Attention
Shuai Wang, Malu Zhang, Dehao Zhang +7
The combination of Spiking Neural Networks (SNNs) and Vision Transformers (ViTs) holds potential for achieving both energy efficiency and high performance, particularly suitable fo…