2 citations · 2 across the 2 of their papers we have counts for
2 papers
cs.CL2024
Conveyor: Efficient Tool-aware LLM Serving with Tool Partial Execution
Yechen Xu, Xinhao Kong, Tingjun Chen +1
The complexity of large language model (LLM) serving workloads has substantially increased due to the integration with external tool invocations, such as ChatGPT plugins. In this p…
cs.NI2023★ 2 cited
Remote Procedure Call as a Managed System Service
Jingrong Chen, Yongji Wu, Shihan Lin +6
Remote Procedure Call (RPC) is a widely used abstraction for cloud computing. The programmer specifies type information for each remote procedure, and a compiler generates stub cod…