The Shape of Addition: Geometric Structures of Arithmetic in Large Language Models

Liuyuan Wen, Xun Zhu, Lihao Huang +2

Large Language Models exhibit paradoxical fragility in fundamental arithmetic, implying a disconnect between internal computation and discrete output. By analyzing the residual str…