Domain Adaptation for Sparse-Data Settings: What Do We Gain by Not Using Bert?

Marina Sedinkina, Martin Schmitt, Hinrich Schütze

The practical success of much of NLP depends on the availability of training data. However, in real-world scenarios, training data is often scarce, not least because many applicati…