Pre-trained language models as knowledge bases for Automotive Complaint Analysis

V. D. Viellieber, M. Aßenmacher

Recently it has been shown that large pre-trained language models like BERT (Devlin et al., 2018) are able to store commonsense factual knowledge captured in its pre-training corpu…