12 citations · 19 across the 5 of their papers we have counts for
Showing 2023Show all
2 papers · 1 filter
cs.RO2023★ 7 cited
TypeFly: Flying Drones with Large Language Model
Guojun Chen, Xiaojing Yu, Neiwen Ling +1
Recent advancements in robot control using large language models (LLMs) have demonstrated significant potential, primarily due to LLMs' capabilities to understand natural language…
cs.CL2023★ 12 cited
Prompt Cache: Modular Attention Reuse for Low-Latency Inference
In Gim, Guojun Chen, Seung-seob Lee +3
We present Prompt Cache, an approach for accelerating inference for large language models (LLM) by reusing attention states across different LLM prompts. Many input prompts have ov…