3 citations · 6 across the 4 of their papers we have counts for
4 papers
Fourier or Wavelet bases as counterpart self-attention in spikformer for efficient visual classification
Qingyu Wang, Duzhen Zhang, Tilelin Zhang +1
Energy-efficient spikformer has been proposed by integrating the biologically plausible spiking neural network (SNN) and artificial Transformer, whereby the Spiking Self-Attention…
ODE-based Recurrent Model-free Reinforcement Learning for POMDPs
Xuanle Zhao, Duzhen Zhang, Liyuan Han +2
Neural ordinary differential equations (ODEs) are widely recognized as the standard for modeling physical mechanisms, which help to perform approximate inference in unknown physica…
Attention-free Spikformer: Mixing Spike Sequences with Simple Linear Transforms
Qingyu Wang, Duzhen Zhang, Tielin Zhang +1
By integrating the self-attention capability and the biological properties of Spiking Neural Networks (SNNs), Spikformer applies the flourishing Transformer architecture to SNNs de…
Complex Dynamic Neurons Improved Spiking Transformer Network for Efficient Automatic Speech Recognition
Minglun Han, Qingyu Wang, Tielin Zhang +3
The spiking neural network (SNN) using leaky-integrated-and-fire (LIF) neurons has been commonly used in automatic speech recognition (ASR) tasks. However, the LIF neuron is still…