LLMs learn different forms of metacognition when trained to predict their own accuracy

Nicolas Yax, Stefano Palminteri, Pierre-Yves Oudeyer

Large language models are trained to always produce an answer, regardless of whether they possess the relevant knowledge, which leads them to fabricate facts. Prior work has shown…