Confidence Regulation Neurons in Language Models

Alessandro Stolfo, Ben Wu, Wes Gurnee +4

Despite their widespread use, the mechanisms by which large language models (LLMs) represent and regulate uncertainty in next-token predictions remain largely unexplored. This stud…