Latenrgy: Model Agnostic Latency and Energy Consumption Prediction for Binary Classifiers

Jason M. Pittman

Machine learning systems increasingly drive innovation across scientific fields and industry, yet challenges in compute overhead, specifically during inference, limit their scalabi…