2 citations · 2 across the 10 of their papers we have counts for
Showing cs.GTShow all
2 papers · 1 filter
cs.GT2026
Routing, Cascades, and User Choice for LLMs
Rafid Mahmood
To mitigate the trade-offs between performance and costs, LLM providers route user tasks to different models based on task difficulty and latency. We study the effect of LLM routin…
cs.GT2024★ 2 cited
Pricing and Competition for Generative AI
Rafid Mahmood
Compared to classical machine learning (ML) models, generative models offer a new usage paradigm where (i) a single model can be used for many different tasks out-of-the-box; (ii)…