Morello: Compiling Fast Neural Networks with Dynamic Programming and Spatial Compression

Samuel J. Kaufman, René Just, Rastislav Bodik

High-throughput neural network inference requires coordinating many optimization decisions, including parallel tiling, microkernel selection, and data layout. The product of these…