most citedParallel Spiking Neurons with High Efficiency and Ability to Learn Long-term Dependencies

15 citations · 37 across the 9 of their papers we have counts for

collaborators

9 papers

cs.NE2023★ 1 cited

Long-Range Feedback Spiking Network Captures Dynamic and Static Representations of the Visual Cortex under Movie Stimuli

Liwei Huang, Zhengyu Ma, Liutao Yu +2

Deep neural networks (DNNs) are widely used models for investigating biological visual representations. However, existing DNNs are mostly designed to analyze neural responses to st…

cs.NE2023

Auto-Spikformer: Spikformer Architecture Search

Kaiwei Che, Zhaokun Zhou, Zhengyu Ma +5

The integration of self-attention mechanisms into Spiking Neural Networks (SNNs) has garnered considerable interest in the realm of advanced deep learning, primarily due to their b…

cs.CV2023

Temporal Contrastive Learning for Spiking Neural Networks

Haonan Qiu, Zeyin Song, Yanqi Chen +6

Biologically inspired spiking neural networks (SNNs) have garnered considerable attention due to their low-energy consumption and spatio-temporal information processing capabilitie…

cs.NE2023★ 5 cited

Enhancing the Performance of Transformer-based Spiking Neural Networks by SNN-optimized Downsampling with Precise Gradient Backpropagation

Chenlin Zhou, Han Zhang, Zhaokun Zhou +5

Deep spiking neural networks (SNNs) have drawn much attention in recent years because of their low power consumption, biological rationality and event-driven property. However, sta…

cs.NE2023★ 7 cited

Binary stochasticity enabled highly efficient neuromorphic deep learning achieves better-than-software accuracy

Yang Li, Wei Wang, Ming Wang +13

Deep learning needs high-precision handling of forwarding signals, backpropagating errors, and updating weights. This is inherently required by the learning algorithm since the gra…

cs.NE2023★ 15 cited

Parallel Spiking Neurons with High Efficiency and Ability to Learn Long-term Dependencies

Wei Fang, Zhaofei Yu, Zhaokun Zhou +5

Vanilla spiking neurons in Spiking Neural Networks (SNNs) use charge-fire-reset neuronal dynamics, which can only be simulated serially and can hardly learn long-time dependencies.…

q-bio.NC2023

Deep Spiking Neural Networks with High Representation Similarity Model Visual Pathways of Macaque and Mouse

Liwei Huang, Zhengyu Ma, Liutao Yu +2

Deep artificial neural networks (ANNs) play a major role in modeling the visual pathways of primate and rodent. However, they highly simplify the computational properties of neuron…

cs.LG2023★ 6 cited

A Unified Framework for Soft Threshold Pruning

Yanqi Chen, Zhengyu Ma, Wei Fang +3

Soft threshold pruning is among the cutting-edge pruning methods with state-of-the-art performance. However, previous methods either perform aimless searching on the threshold sche…

q-bio.NC2016★ 3 cited

New hallmarks of criticality in recurrent neural networks

Yahya Karimipanah, Zhengyu Ma, Ralf Wessel

A rigorous understanding of brain dynamics and function requires a conceptual bridge between multiple levels of organization, including neural spiking and network-level population…