Cache-Aware Prompt Compression:A Two-Tier Cost Model for LLM API Caching

Yan Song

Production LLM deployments combine two cost-reduction primitives: prompt caching (a discounted rate for re-used token prefixes) and prompt compression (fewer tokens sent). The comp…