KeyPooling: Measuring Where LLM API Relay Paths Collapse Prompt Cache Isolation

Bowen Sun, Yixi Cai, Xiaogeng Liu +3

Large language model (LLM) API relays authenticate customers separately but often forward requests through shared provider credentials. Providers scope prompt caches to upstream pr…