1 paper · 1 filter
Yifei Wang, Tianlin Li, Xiaohan Zhang +3
Inference optimization aims to minimize the latency and resource consumption of LLM inference while preserving output quality, making large-scale deployment practical and cost-effe…