TRACER: Trace-Based Adaptive Cost-Efficient Routing for LLM Classification

Adam Rida

Every call to an LLM classification endpoint produces a labeled input-output pair already retained in production logs. These pairs constitute a free, growing training set: a lightw…