Predicting Linear Relational Decodability Without the Relation

Jonas Rohweder, Adrian Mülthaler, Faridoun Mehri +3

Linear relational embeddings (LREs) approximate a language model's subject-to-object mapping with an affine function. Their faithfulness varies enormously across relations, from ne…