Emergence and Function of Abstract Representations in Self-Supervised Transformers

Quentin RV. Ferry, Joshua Ching, Takashi Kawai

Human intelligence relies in part on our brains' ability to create abstract mental models that succinctly capture the hidden blueprint of our reality. Such abstract world models no…