Mind The Gap: Quantifying Mechanistic Gaps in Algorithmic Reasoning via Neural Compilation

Lucas Saldyt, Subbarao Kambhampati

This paper aims to understand how neural networks learn algorithmic reasoning by addressing two questions: How faithful are learned algorithms when they are effective, and why do n…