FlexiFlow: Bandit-based Model Switching in ML Workflows

Abhilash Jindal, Todd Nief, Bhanu Prakash Vangala +6

Model optimizations help improve inference performance and accuracy of ML workflows. However, relying on a single model to perform inference across all data batches often fails to…