Additive Multi-Step Markov Chains and the Curse of Dimensionality in Large Language Models

O. V. Usatenko, S. S. Melnyk, G. M. Pritula

Large-scale language models (LLMs) operate in extremely high-dimensional state spaces, where both token embeddings and their hidden representations create complex dependencies that…