"We Have No Idea How Models will Behave in Production until Production": How Engineers Operationalize Machine Learning

Shreya Shankar, Rolando Garcia, Joseph M Hellerstein +1

Organizations rely on machine learning engineers (MLEs) to deploy models and maintain ML pipelines in production. Due to models' extensive reliance on fresh data, the operationaliz…