On the (Intuitionistic) Logic of Next-Token Prediction

Paul Tarau

We model in intuitionistic implicational logic the key enabler of today's GenerativeAI: the next-token prediction in autoregressive causal neural networks. In our framework, next-t…