How to Pre-Train Your Model? Comparison of Different Pre-Training Models for Biomedical Question Answering

Sanjay Kamath, Brigitte Grau, Yue Ma

Using deep learning models on small scale datasets would result in overfitting. To overcome this problem, the process of pre-training a model and fine-tuning it to the small scale…