Where We Have Arrived in Proving the Emergence of Sparse Symbolic Concepts in AI Models

Qihan Ren, Jiayang Gao, Wen Shen +1

This study aims to prove the emergence of symbolic concepts (or more precisely, sparse primitive inference patterns) in well-trained deep neural networks (DNNs). Specifically, we p…