StreamTensor: Make Tensors Stream in Dataflow Accelerators for LLMs

Hanchen Ye, Deming Chen

Efficient execution of deep learning workloads on dataflow architectures is crucial for overcoming memory bottlenecks and maximizing performance. While streaming intermediate resul…