4 citations · 7 across the 2 of their papers we have counts for
2 papers
cs.LG2023★ 3 cited
PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU
Yixin Song, Zeyu Mi, Haotong Xie +1
This paper introduces PowerInfer, a high-speed Large Language Model (LLM) inference engine on a personal computer (PC) equipped with a single consumer-grade GPU. The key principle…
cs.OS2022★ 4 cited
DuVisor: a User-level Hypervisor Through Delegated Virtualization
Jiahao Chen, Dingji Li, Zeyu Mi +4
Today's mainstream virtualization systems comprise of two cooperative components: a kernel-resident driver that accesses virtualization hardware and a user-level helper process tha…