activity
20192022
most citedHardware Accelerator for Multi-Head Attention and Position-Wise Feed-Forward in the Transformer

12 citations · 27 across the 5 of their papers we have counts for

collaborators
Showing 2021Show all

1 paper · 1 filter

cs.CL2021

Elbert: Fast Albert with Confidence-Window Based Early Exit

Keli Xie, Siyuan Lu, Meiqi Wang +1

Despite the great success in Natural Language Processing (NLP) area, large pre-trained language models like BERT are not well-suited for resource-constrained or real-time applicati…