Streaming Model Cascades for Semantic SQL

Paweł Liskowski, Kyle Schmaus

Modern data warehouses extend SQL with semantic operators that invoke large language models on each qualifying row, making per-row inference orders of magnitude more expensive than…