2 citations · 7 across the 4 of their papers we have counts for
4 papers · 1 filter
Transformers Use Causal World Models in Maze-Solving Tasks
Alex F. Spies, William Edwards, Michael I. Ivanitskiy +5
Recent studies in interpretability have explored the inner workings of transformer models trained on tasks across various domains, often discovering that these networks naturally d…
On Logical Extrapolation for Mazes with Recurrent and Implicit Networks
Brandon Knutson, Amandin Chyba Rabeendran, Michael Ivanitskiy +4
Recent work suggests that certain neural network architectures -- particularly recurrent neural networks (RNNs) and implicit neural networks (INNs) -- are capable of logical extrap…
Structured World Representations in Maze-Solving Transformers
Michael Igorevich Ivanitskiy, Alex F. Spies, Tilman Räuker +9
Transformer models underpin many recent advances in practical machine learning applications, yet understanding their internal behavior continues to elude researchers. Given the siz…
A Configurable Library for Generating and Manipulating Maze Datasets
Michael Igorevich Ivanitskiy, Rusheb Shah, Alex F. Spies +8
Understanding how machine learning models respond to distributional shifts is a key research challenge. Mazes serve as an excellent testbed due to varied generation algorithms offe…