Can the Inference Logic of Large Language Models be Disentangled into Symbolic Concepts?

Wen Shen, Lei Cheng, Yuxiao Yang +2

In this paper, we explain the inference logic of large language models (LLMs) as a set of symbolic concepts. Many recent studies have discovered that traditional DNNs usually encod…