290 citations · 291 across the 4 of their papers we have counts for
Showing 2025Show all
2 papers · 1 filter
cs.DC2025
Nightjar: Dynamic Adaptive Speculative Decoding for Large Language Models Serving
Rui Li, Zhaoning Zhang, Libo Zhang +3
Speculative decoding (SD) accelerates LLM inference by verifying draft tokens in parallel. However, this method presents a critical trade-off: it improves throughput in low-load, m…
cs.DC2025
Joint: Orchestrating Serverless Workflows on Jointcloud FaaS Systems
Rui Li, Jianfei Liu, Zhilin Yang +3
Existing serverless workflow orchestration systems are predominantly designed for a single-cloud FaaS system, leading to vendor lock-in. This restricts performance optimization, co…