25 citations · 25 across the 13 of their papers we have counts for
Showing 2026Show all
3 papers · 1 filter
cs.DC2026
vSkipper: Translating Dynamic Layer Skipping into LLM Serving Gains
Wei Da, Yavuz Ferhatosmanoglu, Evangelia Kalyvianaki
Dynamic layer skipping reduces LLM computation by allowing each token to execute only a subset of the model's layers. However, existing skippers rely on specialized generation loop…
cs.DC2026
RouteBalance: Fused Model Routing and Load Balancing for Heterogeneous LLM Serving
Wei Da, Evangelia Kalyvianaki
Current heterogeneous LLM serving clusters decouple request scheduling into two independent tiers: learned model routers select a model based on the prompt without visibility into…
cs.DC2026
LLM-Emu: Native Runtime Emulation of LLM Inference via Profile-Driven Sampling
Wei Da, Evangelia Kalyvianaki
Realistic evaluation of LLM serving systems requires online workloads, dynamic arrivals, queueing, and the serving engine's local scheduling for execution batching, but running suc…