SqueezeBERT: What can computer vision teach NLP about efficient neural networks?

Forrest N. Iandola, Albert E. Shaw, Ravi Krishna +1

Humans read and write hundreds of billions of messages every day. Further, due to the availability of large datasets, large computing systems, and better neural network models, nat…