Tracing and Manipulating Intermediate Values in Neural Math Problem Solvers

Yuta Matsumoto, Benjamin Heinzerling, Masashi Yoshikawa +1

How language models process complex input that requires multiple steps of inference is not well understood. Previous research has shown that information about intermediate values o…