12 citations · 16 across the 3 of their papers we have counts for
3 papers
cs.LG2022★ 2 cited
Dynamic N:M Fine-grained Structured Sparse Attention Mechanism
Zhaodong Chen, Yuying Quan, Zheng Qu +3
Transformers are becoming the mainstream solutions for various tasks like NLP and Computer vision. Despite their success, the high complexity of the attention mechanism hinders the…
cs.LG2021★ 12 cited
Transformer Acceleration with Dynamic Sparse Attention
Liu Liu, Zheng Qu, Zhaodong Chen +2
Transformers are the mainstream of NLP applications and are becoming increasingly popular in other domains such as Computer Vision. Despite the improvements in model quality, the e…
cs.NE2021★ 2 cited
H2Learn: High-Efficiency Learning Accelerator for High-Accuracy Spiking Neural Networks
Ling Liang, Zheng Qu, Zhaodong Chen +6
Although spiking neural networks (SNNs) take benefits from the bio-plausible neural modeling, the low accuracy under the common local synaptic plasticity learning rules limits thei…