STI: Turbocharge NLP Inference at the Edge via Elastic Pipelining

Liwei Guo, Wonkyo Choe, Felix Xiaozhu Lin

Natural Language Processing (NLP) inference is seeing increasing adoption by mobile applications, where on-device inference is desirable for crucially preserving user data privacy…