most citedRetroInfer: A Vector Storage Engine for Scalable Long-Context LLM Inference

1 citations · 1 across the 2 of their papers we have counts for

collaborators
Showing cs.DCShow all

1 paper · 1 filter

cs.DC2026

S-HPLB: Efficient LLM Attention Serving via Sparsity-Aware Head Parallelism Load Balance

Di Liu, Yifei Liu, Chen Chen +4

With the increasing volumes of Large Language Models (LLMs) and the expanding context lengths, attention computation has become a key performance bottleneck in LLM serving. For fas…