87 citations · 225 across the 56 of their papers we have counts for
32 papers · 1 filter
Rethinking Pairwise Token Interaction in Spiking Transformers
Sicheng Shen, Dongcheng Zhao, Zhiyuan Li +5
Spiking Transformers inherit token interaction mechanisms from conventional Transformers, yet their sparse binary representations fundamentally alter how token-to-token communicati…
Spiking Local Interaction and Adaptive Complementary Fusion for Spiking Transformer
Dongcheng Zhao, Sicheng Shen, Zhenyu Yang +6
Spiking Transformers model token interactions primarily through spiking self-attention (SSA). However, binary query and key representations map continuous similarities to sparse an…
TEFormer: Structured Bidirectional Temporal Enhancement Modeling in Spiking Transformers
Sicheng Shen, Mingyang Lv, Bing Han +4
In recent years, Spiking Neural Networks (SNNs) have achieved remarkable progress, with Spiking Transformers emerging as a promising architecture for energy-efficient sequence mode…
Incorporating brain-inspired mechanisms for multimodal learning in artificial intelligence
Xiang He, Dongcheng Zhao, Yang Li +3
Multimodal learning enhances the perceptual capabilities of cognitive systems by integrating information from different sensory modalities. However, existing multimodal fusion rese…
STEP: A Unified Spiking Transformer Evaluation Platform for Fair and Reproducible Benchmarking
Sicheng Shen, Dongcheng Zhao, Linghao Feng +5
Spiking Transformers have recently emerged as promising architectures for combining the efficiency of spiking neural networks with the representational power of self-attention. How…
Biologically Inspired Spiking Diffusion Model with Adaptive Lateral Selection Mechanism
Linghao Feng, Dongcheng Zhao, Sicheng Shen +1
Lateral connection is a fundamental feature of biological neural circuits, facilitating local information processing and adaptive learning. In this work, we integrate lateral conne…
: Enhanced Information Flow in Spiking Neural Networks with High Hardware Compatibility
Guobin Shen, Jindong Li, Tenglong Li +2
Spiking Neural Networks (SNNs) hold promise for energy-efficient, biologically inspired computing. We identify substantial informatio loss during spike transmission, linked to temp…
Directly Training Temporal Spiking Neural Network with Sparse Surrogate Gradient
Yang Li, Feifei Zhao, Dongcheng Zhao +1
Brain-inspired Spiking Neural Networks (SNNs) have attracted much attention due to their event-based computing and energy-efficient features. However, the spiking all-or-none natur…
Time Cell Inspired Temporal Codebook in Spiking Neural Networks for Enhanced Image Generation
Linghao Feng, Dongcheng Zhao, Sicheng Shen +3
This paper presents a novel approach leveraging Spiking Neural Networks (SNNs) to construct a Variational Quantized Autoencoder (VQ-VAE) with a temporal codebook inspired by hippoc…
Neuro-Vision to Language: Enhancing Brain Recording-based Visual Reconstruction and Language Interaction
Guobin Shen, Dongcheng Zhao, Xiang He +5
Decoding non-invasive brain recordings is pivotal for advancing our understanding of human cognition but faces challenges due to individual differences and complex neural signal re…
Parallel Spiking Unit for Efficient Training of Spiking Neural Networks
Yang Li, Yinqian Sun, Xiang He +3
Efficient parallel computing has become a pivotal element in advancing artificial intelligence. Yet, the deployment of Spiking Neural Networks (SNNs) in this domain is hampered by…
TIM: An Efficient Temporal Interaction Module for Spiking Transformer
Sicheng Shen, Dongcheng Zhao, Guobin Shen +1
Spiking Neural Networks (SNNs), as the third generation of neural networks, have gained prominence for their biological plausibility and computational efficiency, especially in pro…
Astrocyte-Enabled Advancements in Spiking Neural Networks for Large Language Modeling
Guobin Shen, Dongcheng Zhao, Yiting Dong +4
Within the complex neuroarchitecture of the brain, astrocytes play crucial roles in development, structure, and metabolism. These cells regulate neural activity through tripartite…
Is Conventional SNN Really Efficient? A Perspective from Network Quantization
Guobin Shen, Dongcheng Zhao, Tenglong Li +2
Spiking Neural Networks (SNNs) have been widely praised for their high energy efficiency and immense potential. However, comprehensive research that critically contrasts and correl…
FireFly v2: Advancing Hardware Support for High-Performance Spiking Neural Network with a Spatiotemporal FPGA Accelerator
Jindong Li, Guobin Shen, Dongcheng Zhao +2
Spiking Neural Networks (SNNs) are expected to be a promising alternative to Artificial Neural Networks (ANNs) due to their strong biological interpretability and high energy effic…
Learning the Plasticity: Plasticity-Driven Learning Framework in Spiking Neural Networks
Guobin Shen, Dongcheng Zhao, Yiting Dong +3
The evolution of the human brain has led to the development of complex synaptic plasticity, enabling dynamic adaptation to a constantly evolving world. This progress inspires our e…
Improving Stability and Performance of Spiking Neural Networks through Enhancing Temporal Consistency
Dongcheng Zhao, Guobin Shen, Yiting Dong +2
Spiking neural networks have gained significant attention due to their brain-like information processing capabilities. The use of surrogate gradients has made it possible to train…
Spiking Generative Adversarial Network with Attention Scoring Decoding
Linghao Feng, Dongcheng Zhao, Yi Zeng
Generative models based on neural networks present a substantial challenge within deep learning. As it stands, such models are primarily limited to the domain of artificial neural…
Dive into the Power of Neuronal Heterogeneity
Guobin Shen, Dongcheng Zhao, Yiting Dong +2
The biological neural network is a vast and diverse structure with high neural heterogeneity. Conventional Artificial Neural Networks (ANNs) primarily focus on modifying the weight…
Temporal Knowledge Sharing enable Spiking Neural Network Learning from Past and Future
Yiting Dong, Dongcheng Zhao, Yi Zeng
Spiking Neural Networks (SNNs) have attracted significant attention from researchers across various domains due to their brain-like information processing mechanism. However, SNNs…
MSAT: Biologically Inspired Multi-Stage Adaptive Threshold for Conversion of Spiking Neural Networks
Xiang He, Yang Li, Dongcheng Zhao +2
Spiking Neural Networks (SNNs) can do inference with low power consumption due to their spike sparsity. ANN-SNN conversion is an efficient way to achieve deep SNNs by converting we…
Exploiting High Performance Spiking Neural Networks with Efficient Spiking Patterns
Guobin Shen, Dongcheng Zhao, Yi Zeng
Spiking Neural Networks (SNNs) use discrete spike sequences to transmit information, which significantly mimics the information transmission of the brain. Although this binarized f…
FireFly: A High-Throughput Hardware Accelerator for Spiking Neural Networks with Efficient DSP and Memory Optimization
Jindong Li, Guobin Shen, Dongcheng Zhao +2
Spiking neural networks (SNNs) have been widely used due to their strong biological interpretability and high energy efficiency. With the introduction of the backpropagation algori…
BrainCog: A Spiking Neural Network based Brain-inspired Cognitive Intelligence Engine for Brain-inspired AI and Brain Simulation
Yi Zeng, Dongcheng Zhao, Feifei Zhao +16
Spiking neural networks (SNNs) have attracted extensive attentions in Brain-inspired Artificial Intelligence and computational neuroscience. They can be used to simulate biological…