From Static Inference to Dynamic Interaction: A Survey of Streaming Large Language Models

Junlong Tong, Zilong Wang, YuJie Ren +4

Standard Large Language Models (LLMs) are predominantly designed for static inference with pre-defined inputs, which limits their applicability in dynamic, real-time scenarios. To…