Self-Aware Knowledge Probing: Evaluating Language Models' Relational Knowledge through Confidence Calibration

Christopher Kissling, Elena Merdjanovska, Alan Akbik

Knowledge probing quantifies how much relational knowledge a language model (LM) has acquired during pre-training. Existing knowledge probes evaluate model capabilities through met…