4 citations · 7 across the 2 of their papers we have counts for
1 paper · 1 filter
Yixin Song, Zeyu Mi, Haotong Xie +1
This paper introduces PowerInfer, a high-speed Large Language Model (LLM) inference engine on a personal computer (PC) equipped with a single consumer-grade GPU. The key principle…