most citedAnalytically-Driven Resource Management for Cloud-Native Microservices

1 citations · 1 across the 3 of their papers we have counts for

collaborators
Showing cs.AIShow all

1 paper · 1 filter

cs.AI2025

Ascendra: Dynamic Request Prioritization for Efficient LLM Serving

Azam Ikram, Xiang Li, Sameh Elnikety +1

The rapid advancement of Large Language Models (LLMs) has driven the need for more efficient serving strategies. In this context, efficiency refers to the proportion of requests th…