Unused information in token probability distribution of generative LLM: improving LLM reading comprehension through calculation of expected values

Krystian Zawistowski

LLM text decoding is key component for perceived LLM quality. We demonstrate two experiments showing that decoding methods could be improved by manipulation of token probabilities.…