Transformer Encoder for Social Science

Haosen Ge, In Young Park, Xuancheng Qian +1

High-quality text data has become an important data source for social scientists. We have witnessed the success of pretrained deep neural network models, such as BERT and RoBERTa,…