Demystifying BERT: Implications for Accelerator Design

Suchita Pati, Shaizeen Aga, Nuwan Jayasena +1

Transfer learning in natural language processing (NLP), as realized using models like BERT (Bi-directional Encoder Representation from Transformer), has significantly improved lang…