1 paper · 1 filter
Tianyi Wang, Huawei Fan, Yuanchao Shu +2
LLM inference is inherently expensive, even a modest slowdown can translate into substantial operating costs and severe availability risks. Recently, a growing body of research kno…