From Memories to Maps: Mechanisms of In-Context Reinforcement Learning in Transformers

Ching Fang, Kanaka Rajan

Humans and animals show remarkable learning efficiency, adapting to new environments with minimal experience. This capability is not well captured by standard reinforcement learnin…