12 citations · 19 across the 5 of their papers we have counts for
5 papers
TypeGo: An OS Runtime for Embodied Agents
Guojun Chen, Alex Schott, Lin Zhong
Large language models (LLMs) can plan behavior for embodied agents from natural language, but treating the LLM as a request/response oracle on the critical path is fundamentally at…
TimelyLLM: Segmented LLM Serving System for Time-sensitive Robotic Applications
Neiwen Ling, Guojun Chen, Lin Zhong
Large Language Models (LLMs) such as GPT-4 and Llama3 can already comprehend complex commands and process diverse tasks. This advancement facilitates their application in controlli…
TypeFly: Flying Drones with Large Language Model
Guojun Chen, Xiaojing Yu, Neiwen Ling +1
Recent advancements in robot control using large language models (LLMs) have demonstrated significant potential, primarily due to LLMs' capabilities to understand natural language…
Prompt Cache: Modular Attention Reuse for Low-Latency Inference
In Gim, Guojun Chen, Seung-seob Lee +3
We present Prompt Cache, an approach for accelerating inference for large language models (LLM) by reusing attention states across different LLM prompts. Many input prompts have ov…
POD: A Smartphone That Flies
Guojun Chen, Noah Weiner, Lin Zhong
We present POD, a smartphone that flies, as a new way to achieve hands-free, eyes-up mobile computing. Unlike existing drone-carried user interfaces, POD features a smartphone-size…