Beyond Reproducibility: Token Probabilities Expose Large Language Model Nondeterminism

Tairan Fu, Gonzalo Martínez, Javier Conde +4

The execution of Large Language Models (LLMs) has been shown to produce nondeterministic results when run on Graphics Processing Units (GPUs), even when they are configured to prod…