InstantInfer: Enabling Fast LLM Cold Start with Communicating Finite Automata

Yitao Yuan, Yongchao He, Shaoke Fang +1

Cold starts in large language model (LLM) inference services significantly affect user experience, yet they remain inefficient due to sequential initialization and a massive number…