Mirage: A Multi-Level Superoptimizer for Tensor Programs

Mengdi Wu, Xinhao Cheng, Shengyu Liu +7

We introduce Mirage, the first multi-level superoptimizer for tensor programs. A key idea in Mirage is $\hat{I}¼$Graphs, a uniform representation of tensor programs at the kernel, thread…