What's the Difference? Supporting Users in Identifying the Effects of Prompt and Model Changes Through Token Patterns

Michael A. Hedderich, Anyi Wang, Raoyuan Zhao +3

Prompt engineering for large language models is challenging, as even small prompt perturbations or model changes can significantly impact the generated output texts. Existing evalu…