paper

Notes on the Mathematical Structure of GPT LLM Architectures

arXiv:2410.19370

Abstract

An exposition of the mathematics underpinning the neural network architecture of a GPT-3-style LLM.

10 pages