464 citations · 628 across the 21 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.CL2021★ 2 cited
Dynamic-TinyBERT: Boost TinyBERT's Inference Efficiency by Dynamic Sequence Length
Shira Guskin, Moshe Wasserblat, Ke Ding +1
Limited computational budgets often prevent transformers from being used in production and from having their high accuracy utilized. TinyBERT addresses the computational efficiency…
cs.CL2021★ 27 cited
Prune Once for All: Sparse Pre-Trained Language Models
Ofir Zafrir, Ariel Larey, Guy Boudoukh +2
Transformer-based language models are applied to a wide range of applications in natural language processing. However, they are inefficient and difficult to deploy. In recent years…