Q-First: Most of Attention Needs Only the Query in Disaggregated LLM Decoding

WenJie Fan

Disaggregated LLM serving puts the KV-cache sweep on memory-optimised hardware and the projections and feed-forward on compute-optimised hardware, then inherits from the decoder bl…