105 citations · 110 across the 3 of their papers we have counts for
3 papers
cs.NE2023
Auto-Spikformer: Spikformer Architecture Search
Kaiwei Che, Zhaokun Zhou, Zhengyu Ma +5
The integration of self-attention mechanisms into Spiking Neural Networks (SNNs) has garnered considerable interest in the realm of advanced deep learning, primarily due to their b…
cs.NE2023★ 5 cited
Enhancing the Performance of Transformer-based Spiking Neural Networks by SNN-optimized Downsampling with Precise Gradient Backpropagation
Chenlin Zhou, Han Zhang, Zhaokun Zhou +5
Deep spiking neural networks (SNNs) have drawn much attention in recent years because of their low power consumption, biological rationality and event-driven property. However, sta…
cs.NE2022★ 105 cited
Spikformer: When Spiking Neural Network Meets Transformer
Zhaokun Zhou, Yuesheng Zhu, Chao He +4
We consider two biologically plausible structures, the Spiking Neural Network (SNN) and the self-attention mechanism. The former offers an energy-efficient and event-driven paradig…