14 citations · 18 across the 15 of their papers we have counts for
17 papers
TP-Spikformer: Token Pruned Spiking Transformer
Wenjie Wei, Xiaolong Zhou, Malu Zhang +8
Spiking neural networks (SNNs) offer an energy-efficient alternative to traditional neural networks due to their event-driven computing paradigm. However, recent advancements in sp…
BSO: Binary Spiking Online Optimization Algorithm
Yu Liang, Yu Yang, Wenjie Wei +4
Binary Spiking Neural Networks (BSNNs) offer promising efficiency advantages for resource-constrained computing. However, their training algorithms often require substantial memory…
Unveiling the Spatial-temporal Effective Receptive Fields of Spiking Neural Networks
Jieyuan Zhang, Xiaolong Zhou, Shuai Wang +6
Spiking Neural Networks (SNNs) demonstrate significant potential for energy-efficient neuromorphic computing through an event-driven paradigm. While training methods and computatio…
SNN: Sub-bit Spiking Neural Networks
Wenjie Wei, Malu Zhang, Jieyuan Zhang +8
Spiking Neural Networks (SNNs) offer an energy-efficient paradigm for machine intelligence, but their continued scaling poses challenges for resource-limited deployment. Despite re…
Dendritic Resonate-and-Fire Neuron for Effective and Efficient Long Sequence Modeling
Dehao Zhang, Malu Zhang, Shuai Wang +6
The explosive growth in sequence length has intensified the demand for effective and efficient long sequence modeling. Benefiting from intrinsic oscillatory membrane dynamics, Reso…
Training-Free ANN-to-SNN Conversion for High-Performance Spiking Transformer
Jingya Wang, Xin Deng, Wenjie Wei +7
Leveraging the event-driven paradigm, Spiking Neural Networks (SNNs) offer a promising approach for energy-efficient Transformer architectures.While ANN-to-SNN conversion avoids th…
What Is Next for LLMs? Next-Generation AI Computing Hardware Using Photonic Chips
Renjie Li, Wenjie Wei, Qi Xin +7
Large language models (LLMs) are rapidly pushing the limits of contemporary computing hardware. For example, training GPT-3 has been estimated to consume around 1300 MWh of electri…
SDTrack: A Baseline for Event-based Tracking via Spiking Neural Networks
Yimeng Shan, Zhenbang Ren, Haodi Wu +11
Event cameras provide superior temporal resolution, dynamic range, energy efficiency, and pixel bandwidth. Spiking Neural Networks (SNNs) naturally complement event data through di…
Memory-Free and Parallel Computation for Quantized Spiking Neural Networks
Dehao Zhang, Shuai Wang, Yichen Xiao +4
Quantized Spiking Neural Networks (QSNNs) offer superior energy efficiency and are well-suited for deployment on resource-limited edge devices. However, limited bit-width weight an…
Towards Accurate Binary Spiking Neural Networks: Learning with Adaptive Gradient Modulation Mechanism
Yu Liang, Wenjie Wei, Ammar Belatreche +5
Binary Spiking Neural Networks (BSNNs) inherit the eventdriven paradigm of SNNs, while also adopting the reduced storage burden of binarization techniques. These distinct advantage…
QP-SNN: Quantized and Pruned Spiking Neural Networks
Wenjie Wei, Malu Zhang, Zijian Zhou +6
Brain-inspired Spiking Neural Networks (SNNs) leverage sparse spikes to encode information and operate in an asynchronous event-driven manner, offering a highly energy-efficient pa…
Quantized Spike-driven Transformer
Xuerui Qiu, Malu Zhang, Jieyuan Zhang +7
Spiking neural networks are emerging as a promising energy-efficient alternative to traditional artificial neural networks due to their spike-driven paradigm. However, recent resea…
Binary Event-Driven Spiking Transformer
Honglin Cao, Zijian Zhou, Wenjie Wei +6
Transformer-based Spiking Neural Networks (SNNs) introduce a novel event-driven self-attention paradigm that combines the high performance of Transformers with the energy efficienc…
Ternary Spike-based Neuromorphic Signal Processing System
Shuai Wang, Dehao Zhang, Ammar Belatreche +5
Deep Neural Networks (DNNs) have been successfully implemented across various signal processing fields, resulting in significant enhancements in performance. However, DNNs generall…
Global-Local Convolution with Spiking Neural Networks for Energy-efficient Keyword Spotting
Shuai Wang, Dehao Zhang, Kexin Shi +4
Thanks to Deep Neural Networks (DNNs), the accuracy of Keyword Spotting (KWS) has made substantial progress. However, as KWS systems are usually implemented on edge devices, energy…
Q-SNNs: Quantized Spiking Neural Networks
Wenjie Wei, Yu Liang, Ammar Belatreche +6
Brain-inspired Spiking Neural Networks (SNNs) leverage sparse spikes to represent information and process them in an asynchronous event-driven manner, offering an energy-efficient…
Event-Driven Learning for Spiking Neural Networks
Wenjie Wei, Malu Zhang, Jilin Zhang +7
Brain-inspired spiking neural networks (SNNs) have gained prominence in the field of neuromorphic computing owing to their low energy consumption during feedforward inference on ne…