8 citations · 8 across the 4 of their papers we have counts for
4 papers · 1 filter
AvalancheBench: Evaluating Enterprise Data Agents Through Latent World Recovery
Darek Kleczek, Fuheng Zhao, Alexander W. Lee +4
We introduce AvalancheBench, a benchmark for evaluating enterprise data agents through \emph{latent world recovery}. AvalancheBench improves on existing benchmarks in three ways. F…
Evergreen: Efficient Claim Verification for Semantic Aggregates
Alexander W. Lee, Benjamin Han, Shayak Sen +3
With recent semantic query processing engines, semantic aggregation has become a primitive operator, enabling the reduction of a relation into a natural language aggregate using an…
Making Prompts First-Class Citizens for Adaptive LLM Pipelines
Ugur Cetintemel, Shu Chen, Alexander W. Lee +3
Modern LLM pipelines increasingly resemble complex data-centric applications: they retrieve data, correct errors, call external tools, and coordinate interactions between agents. Y…
Semantic Integrity Constraints: Declarative Guardrails for AI-Augmented Data Processing Systems
Alexander W. Lee, Justin Chan, Michael Fu +4
AI-augmented data processing systems (DPSs) integrate large language models (LLMs) into query pipelines, allowing powerful semantic operations on structured and unstructured data.…