15 papers
Who's Keeping Score? Interactive Steering of LLM-Powered Scoring with Attune
Bhavya Chopra, Meng Chen, Rebecca Dang +5
Large language models (LLMs) are increasingly used to score text records at scale (e.g., rating candidate resumes on a 1-5 scale). However, existing LLM-powered approaches do not a…
Scout: Scalable Document Extraction via Data Similarity
Yiming Lin, Chiyu Hao, Shreya Shankar +1
Extracting values from large document collections powers data analysis across many domains. Frontier LLMs extract such values accurately, but processing an entire collection with o…
Semantic Data Processing with Holistic Data Understanding
Youran Sun, Sepanta Zeighami, Bhavya Chopra +2
Semantic operators have increasingly become integrated within data systems to enable processing data using Large Language Models (LLMs). Despite significant recent effort in improv…
Multi-Objective Agentic Rewrites for Unstructured Data Processing
Lindsey Linxi Wei, Shreya Shankar, Sepanta Zeighami +3
One year ago, we open-sourced DocETL, a declarative system for LLM-powered data processing that, as of March 2026, has 3.7K GitHub stars and users across domains (e.g., journalism,…
Can AI Agents Answer Your Data Questions? A Benchmark for Data Agents
Ruiying Ma, Shreya Shankar, Ruiqi Chen +7
Users across enterprises increasingly rely on AI agents to query their data through natural language. However, building reliable data agents remains difficult because real-world da…
Task Cascades for Efficient Unstructured Data Processing
Shreya Shankar, Sepanta Zeighami, Aditya Parameswaran
Modern database systems allow users to query or process unstructured text or document columns using LLM-powered functions. Users can express an operation in natural language (e.g.,…