Query-Centric Optimization of AI Workflows via Approximate Query Processing and Proxy Models

Huayi Wang, Jun Xu, Gromit Yeuk-Yin Chan

Many modern AI workflows, ranging from LLM post-training pipelines to agentic reasoning tasks, can be expressed as declarative queries whose expensive predicate is evaluated by a l…