activity
20212026
most citedA Length Adaptive Algorithm-Hardware Co-design of Transformer on FPGA Through Sparse Attention and Dynamic Pipelining

50 citations · 73 across the 14 of their papers we have counts for

collaborators
Showing 2021Show all

2 papers · 1 filter

cs.CL2021★ 8 cited

Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm

Shaoyi Huang, Dongkuan Xu, Ian E. H. Yen +8

Conventional wisdom in pruning Transformer-based language models is that pruning reduces the model expressiveness and thus is more likely to underfit rather than overfit. However,…

cs.AR2021★ 1 cited

Optimizing FPGA-based Accelerator Design for Large-Scale Molecular Similarity Search

Hongwu Peng, Shiyang Chen, Zhepeng Wang +9

Molecular similarity search has been widely used in drug discovery to identify structurally similar compounds from large molecular databases rapidly. With the increasing size of ch…