4 papers
DSPE: An Energy-Efficient Edge Processor for DeepSeek Inference with MerkleTree-based Incremental Pruning, Multi-Stage Boothing Lookup and Dynamic Adaptive Posit Processing
Yuhan Zhang, Zhou Wang, Zhou Shu +8
In recent years, DeepSeek has achieved strong inference performance but remains hard to deploy on energy-constrained edge devices. This paper presents the DeepSeek Processing Eleme…
ReverB-SNN: Reversing Bit of the Weight and Activation for Spiking Neural Networks
Yufei Guo, Yuhan Zhang, Zhou Jie +5
The Spiking Neural Network (SNN), a biologically inspired neural network infrastructure, has garnered significant attention recently. SNNs utilize binary spike activations for effi…
Spiking Transformer:Introducing Accurate Addition-Only Spiking Self-Attention for Transformer
Yufei Guo, Xiaode Liu, Yuanpei Chen +3
Transformers have demonstrated outstanding performance across a wide range of tasks, owing to their self-attention mechanism, but they are highly energy-consuming. Spiking Neural N…
Take A Shortcut Back: Mitigating the Gradient Vanishing for Training Spiking Neural Networks
Yufei Guo, Yuanpei Chen, Zecheng Hao +5
The Spiking Neural Network (SNN) is a biologically inspired neural network infrastructure that has recently garnered significant attention. It utilizes binary spike activations to…