Improving Inference Performance of Machine Learning with the Divide-and-Conquer Principle

Alex Kogan

Many popular machine learning models scale poorly when deployed on CPUs. In this paper we explore the reasons why and propose a simple, yet effective approach based on the well-kno…