Streaming Tensor Programs: A Streaming Abstraction for Dynamic Parallelism

Gina Sohn, Genghan Zhang, Konstantin Hossfeld +5

Dynamic behaviors are becoming prevalent in tensor applications, like machine learning, where many widely used models contain data-dependent tensor shapes and control flow. However…