Next-Token Prediction and Regret Minimization

Mehryar Mohri, Clayton Sanford, Jon Schneider +2

We consider the question of how to employ next-token prediction algorithms in adversarial online decision-making environments. Specifically, if we train a next-token prediction mod…