6 papers · 1 filter
SpikeX: Exploring Accelerator Architecture and Network-Hardware Co-Optimization for Sparse Spiking Neural Networks
Boxun Xu, Richard Boone, Peng Li
Spiking Neural Networks (SNNs) are promising biologically plausible models of computation which utilize a spiking binary activation function similar to that of biological neurons.…
Bishop: Sparsified Bundling Spiking Transformers on Heterogeneous Cores with Error-Constrained Pruning
Boxun Xu, Yuxuan Yin, Vikram Iyer +1
We present Bishop, the first dedicated hardware accelerator architecture and HW/SW co-design framework for spiking transformers that optimally represents, manages, and processes sp…
Towards 3D Acceleration for low-power Mixture-of-Experts and Multi-Head Attention Spiking Transformers
Boxun Xu, Junyoung Hwang, Pruek Vanna-iampikul +3
Spiking Neural Networks(SNNs) provide a brain-inspired and event-driven mechanism that is believed to be critical to unlock energy-efficient deep learning. The mixture-of-experts a…
Trimming Down Large Spiking Vision Transformers via Heterogeneous Quantization Search
Boxun Xu, Yufei Song, Peng Li
Spiking Neural Networks (SNNs) are amenable to deployment on edge devices and neuromorphic hardware due to their lower dissipation. Recently, SNN-based transformers have garnered s…
Spiking Transformer Hardware Accelerators in 3D Integration
Boxun Xu, Junyoung Hwang, Pruek Vanna-iampikul +2
Spiking neural networks (SNNs) are powerful models of spatiotemporal computation and are well suited for deployment on resource-constrained edge devices and neuromorphic hardware d…
DS2TA: Denoising Spiking Transformer with Attenuated Spatiotemporal Attention
Boxun Xu, Hejia Geng, Yuxuan Yin +1
Vision Transformers (ViT) are current high-performance models of choice for various vision applications. Recent developments have given rise to biologically inspired spiking transf…