3D Optimization for AI Inference Scaling: Balancing Accuracy, Cost, and Latency

Minseok Jung, Abhas Ricky, Muhammad Rameez Chatni

AI inference scaling is often tuned through 1D heuristics (a fixed reasoning pass) or 2D bivariate trade-offs (e.g., accuracy vs. compute), which fail to consider cost and latency…