Easy and Efficient Transformer : Scalable Inference Solution For large NLP model

Gongzheng Li, Yadong Xi, Jingzhen Ding +5

Recently, large-scale transformer-based models have been proven to be effective over various tasks across many domains. Nevertheless, applying them in industrial production require…