1 citations · 1 across the 4 of their papers we have counts for
4 papers
Towards 3D Acceleration for low-power Mixture-of-Experts and Multi-Head Attention Spiking Transformers
Boxun Xu, Junyoung Hwang, Pruek Vanna-iampikul +3
Spiking Neural Networks(SNNs) provide a brain-inspired and event-driven mechanism that is believed to be critical to unlock energy-efficient deep learning. The mixture-of-experts a…
Trimming Down Large Spiking Vision Transformers via Heterogeneous Quantization Search
Boxun Xu, Yufei Song, Peng Li
Spiking Neural Networks (SNNs) are amenable to deployment on edge devices and neuromorphic hardware due to their lower dissipation. Recently, SNN-based transformers have garnered s…
Spiking Transformer Hardware Accelerators in 3D Integration
Boxun Xu, Junyoung Hwang, Pruek Vanna-iampikul +2
Spiking neural networks (SNNs) are powerful models of spatiotemporal computation and are well suited for deployment on resource-constrained edge devices and neuromorphic hardware d…
DISTA: Denoising Spiking Transformer with intrinsic plasticity and spatiotemporal attention
Boxun Xu, Hejia Geng, Yuxuan Yin +1
Among the array of neural network architectures, the Vision Transformer (ViT) stands out as a prominent choice, acclaimed for its exceptional expressiveness and consistent high per…