7 papers
Evergreen: Efficient Claim Verification for Semantic Aggregates
Alexander W. Lee, Benjamin Han, Shayak Sen +3
With recent semantic query processing engines, semantic aggregation has become a primitive operator, enabling the reduction of a relation into a natural language aggregate using an…
AvalancheBench: Evaluating Enterprise Data Agents Through Latent World Recovery
Darek Kleczek, Fuheng Zhao, Alexander W. Lee +4
We introduce AvalancheBench, a benchmark for evaluating enterprise data agents through \emph{latent world recovery}. AvalancheBench improves on existing benchmarks in three ways. F…
Credo: Declarative Control of LLM Pipelines via Beliefs and Policies
Duo Lu, Andrew Crotty, UÄur Ãetintemel +1
Agentic AI systems are becoming commonplace in domains that require long-lived, stateful decision-making in continuously evolving conditions. As such, correctness depends not only…
VectraFlow: Long-Horizon Semantic Processing over Data and Event Streams with LLMs
Shu Chen, Junhan Liu, Deepti Raghavan +1
Monitoring continuous data for meaningful signals increasingly demands long-horizon, stateful reasoning over unstructured streams. However, today's LLM frameworks remain stateless…
Making Prompts First-Class Citizens for Adaptive LLM Pipelines
Ugur Cetintemel, Shu Chen, Alexander W. Lee +3
Modern LLM pipelines increasingly resemble complex data-centric applications: they retrieve data, correct errors, call external tools, and coordinate interactions between agents. Y…
Continuous Prompts: LLM-Augmented Pipeline Processing over Unstructured Streams
Shu Chen, Deepti Raghavan, UÄur Ãetintemel
Monitoring unstructured streams increasingly requires persistent, semantics-aware computation, yet today's LLM frameworks remain stateless and one-shot, limiting their usefulness f…