3 papers
cs.LG2026
FailureAtlas: A Taxonomy of Failure Modes in Multi-Provider LLM Serving Infrastructure
Vishal Pandey, Gopal Singh
Multi-provider LLM gateways reverse proxies that route, load-balance, and rate-limit requests across foundation-model APIs have become critical production infrastructure. Yet the f…
cs.LG2026
ContinuityBench: A Benchmark and Systems Study of Stateful Failover in Multi-Provider LLM Routing
Vishal Pandey, Gopal Singh
In production large language model (LLM) deployments, high API availability guarantees do not equate to conversational continuity. When a primary provider experiences an outage or…
cs.LG2026
Variational Linear Attention: Stable Associative Memory for Long-Context Transformers
Vishal Pandey, Gopal Singh
Linear attention reduces the quadratic cost of softmax attention to , but its memory state grows as in Frobenius norm, causing progressive interfer…