Recursive Offloading for LLM Serving in Multi-tier Networks

Zhiyuan Wu, Sheng Sun, Yuwei Wang +5

Heterogeneous device-edge-cloud computing infrastructures have become widely adopted in telecommunication operators and Wide Area Networks (WANs), offering multi-tier computational…