Understanding Cache Boundness of ML Operators on ARM Processors

Bernhard Klein, Christoph Gratl, Manfred Mücke +1

Machine Learning compilers like TVM allow a fast and flexible deployment on embedded CPUs. This enables the use of non-standard operators, which are common in ML compression techni…