Optimizing Machine Learning Inference Queries with Correlative Proxy Models

Zhihui Yang, Zuozhi Wang, Yicong Huang +3

We consider accelerating machine learning (ML) inference queries on unstructured datasets. Expensive operators such as feature extractors and classifiers are deployed as user-defin…