12 citations · 19 across the 4 of their papers we have counts for
4 papers
TypeGo: An OS Runtime for Embodied Agents
Guojun Chen, Alex Schott, Lin Zhong
Large language models (LLMs) can plan behavior for embodied agents from natural language, but treating the LLM as a request/response oracle on the critical path is fundamentally at…
TimelyLLM: Segmented LLM Serving System for Time-sensitive Robotic Applications
Neiwen Ling, Guojun Chen, Lin Zhong
Large Language Models (LLMs) such as GPT-4 and Llama3 can already comprehend complex commands and process diverse tasks. This advancement facilitates their application in controlli…
TypeFly: Flying Drones with Large Language Model
Guojun Chen, Xiaojing Yu, Neiwen Ling +1
Recent advancements in robot control using large language models (LLMs) have demonstrated significant potential, primarily due to LLMs' capabilities to understand natural language…
Prompt Cache: Modular Attention Reuse for Low-Latency Inference
In Gim, Guojun Chen, Seung-seob Lee +3
We present Prompt Cache, an approach for accelerating inference for large language models (LLM) by reusing attention states across different LLM prompts. Many input prompts have ov…