works on
disaggregated serving 1kv cache transfer 1large language model inference 1network bandwidth optimization 1prefill-decoding separation 1

From the 1 of 5 linked papers with an AI index.

collaborators
Showing cs.OSShow all

1 paper · 1 filter

cs.OS2026

EdgeFlow: Fast Cold Starts for LLMs on Mobile Devices

Yongsheng Yan, Jiacheng Shen, Xuchuan Luo +1

Deploying large language models (LLMs) on mobile devices is an emerging trend to enable data privacy and offline accessibility of LLM applications. Modern mobile neural processing…