TensorCast: The Missing Tensor Management Layer in Large Language Model Infrastructure

Yuhan Zhou, Yuchu Luo, Hao Nie +5

Modern LLM infrastructure increasingly manages tensors not only as computation data, but also as persistent states shared across distributed components. Existing systems optimize i…