LATTICE: Constraint-Directed Scheduling, Memory Planning, and Pipeline Refinement for NPUs

Runhao Liu, Minnan Pei, Fei Ding +5

General-purpose NPUs execute fine-grained command DAGs across heterogeneous compute and memory-transfer engines backed by finite, explicitly managed on-chip memories. This executio…