MLMLM: Link Prediction with Mean Likelihood Masked Language Model

Louis Clouatre, Philippe Trempe, Amal Zouaq +1

Knowledge Bases (KBs) are easy to query, verifiable, and interpretable. They however scale with man-hours and high-quality data. Masked Language Models (MLMs), such as BERT, scale…