290 citations · 291 across the 4 of their papers we have counts for
4 papers
Nightjar: Dynamic Adaptive Speculative Decoding for Large Language Models Serving
Rui Li, Zhaoning Zhang, Libo Zhang +3
Speculative decoding (SD) accelerates LLM inference by verifying draft tokens in parallel. However, this method presents a critical trade-off: it improves throughput in low-load, m…
Joint: Orchestrating Serverless Workflows on Jointcloud FaaS Systems
Rui Li, Jianfei Liu, Zhilin Yang +3
Existing serverless workflow orchestration systems are predominantly designed for a single-cloud FaaS system, leading to vendor lock-in. This restricts performance optimization, co…
NebulaFL: Effective Asynchronous Federated Learning for JointCloud Computing
Fei Gao, Ming Hu, Zhiyu Xie +4
With advancements in AI infrastructure and Trusted Execution Environment (TEE) technology, Federated Learning as a Service (FLaaS) through JointCloud Computing (JCC) is promising t…
Intelligent Computing: The Latest Advances, Challenges and Future
Shiqiang Zhu, Ting Yu, Tao Xu +18
Computing is a critical driving force in the development of human civilization. In recent years, we have witnessed the emergence of intelligent computing, a new computing paradigm…