FlexEE: Self-Speculative and KV-Compatible Early Exiting for Offloading-Aware LLM Inference

Qihu Xie, Ziwei Li, Yi Kang

Large language model (LLM) inference is often constrained by both computation and memory, especially in offloading-based deployments where model weights are transferred across memo…