A non-ergodic framework for understanding emergent capabilities in Large Language Models

Javier Marín

Large language models have emergent capabilities that come unexpectedly at scale, but we need a theoretical framework to explain why and how they emerge. We prove that language mod…