Log Probability Tracking of LLM APIs

Timothée Chauvin, Erwan Le Merrer, François Taïani +1

When using an LLM through an API provider, users expect the served model to remain consistent over time, a property crucial for the reliability of downstream applications and the r…