2 papers
cs.LG2025
On Logical Extrapolation for Mazes with Recurrent and Implicit Networks
Brandon Knutson, Amandin Chyba Rabeendran, Michael Ivanitskiy +4
Recent work suggests that certain neural network architectures -- particularly recurrent neural networks (RNNs) and implicit neural networks (INNs) -- are capable of logical extrap…
cs.LG2025
Transformers Use Causal World Models in Maze-Solving Tasks
Alex F. Spies, William Edwards, Michael I. Ivanitskiy +5
Recent studies in interpretability have explored the inner workings of transformer models trained on tasks across various domains, often discovering that these networks naturally d…