Pricing Time, Not Just Tokens: Latency-Aware Mechanism Design for LLM Inference

Ian McDougall, Karthikeyan Sankaralingam

The economic theory of LLM pricing treats tokens as a homogeneous commodity considering aggregate token count as the main features buyers and sellers consider. We model inference a…