2 papers
cs.CL2026
Additive Multi-Step Markov Chains and the Curse of Dimensionality in Large Language Models
O. V. Usatenko, S. S. Melnyk, G. M. Pritula
Large-scale language models (LLMs) operate in extremely high-dimensional state spaces, where both token embeddings and their hidden representations create complex dependencies that…
cond-mat.stat-mech2022
Information temperature as a measure of DNA's and texts complexity
Oleg Usatenko
C. Shannon introduced the notion of entropy for random sequences. What about their temperature? After discussing some methods for introducing information temperature (IT) for binar…