Transformer-like Inference from Optimal Control

Aditya Kudre, Heng-Sheng Chang, Prashant G. Mehta

Decoder-only transformers compute the conditional probability of the next token from a sequence of past observations. This paper derives, from first principles, inference architect…