A text autoencoder from transformer for fast encoding language representation

Tan Huang

In recent years BERT shows apparent advantages and great potential in natural language processing tasks. However, both training and applying BERT requires intensive time and resour…