On the Impact of Black-box Deployment Strategies for Edge AI on Latency and Model Performance

Jaskirat Singh, Emad Fallahzadeh, Bram Adams +1

Deciding what combination of operators to use across the Edge AI tiers to achieve specific latency and model performance requirements is an open question for MLOps engineers. This…