On the Impact of White-box Deployment Strategies for Edge AI on Latency and Model Performance

Jaskirat Singh, Bram Adams, Ahmed E. Hassan

To help MLOps engineers decide which operator to use in which deployment scenario, this study aims to empirically assess the accuracy vs latency trade-off of white-box (training-ba…