LLMs as High-Dimensional Nonlinear Autoregressive Models with Attention: Training, Alignment and Inference

Vikram Krishnamurthy

Large language models (LLMs) based on transformer architectures are typically described through collections of architectural components and training procedures, obscuring their und…