Attention Is Not Retention: The Orthogonality Constraint in Infinite-Context Architectures

Oliver Zahn, Matt Beton, Simran Chana

Biological memory solves a problem that eludes current AI: storing specific episodic facts without corrupting general semantic knowledge. Complementary Learning Systems theory expl…