11 papers
DA-Studio: An Agentic System for End-to-End Data Analysis
Yizhe Liu, Shaolei Zhang, Ju Fan
Real-world data analysis is a multi-step process over heterogeneous inputs rather than merely producing a final answer. A practical system should autonomously organize multi-step w…
CODA-BENCH: Can Code Agents Handle Data-Intensive Tasks?
Yuxin Zhang, Ju Fan, Meihao Fan +2
Advanced agents are increasingly demonstrating the potential to operate as autonomous engineers, creating a growing demand for evaluation benchmarks that capture the complexity of…
TACO: A Benchmark for Open-Domain Text-to-SQL with Ambiguous and Cross-Database Queries
Chao Deng, Ju Fan, Yuyu Luo +7
Text-to-SQL aims to translate natural language questions into executable SQL queries over structured databases. Existing benchmarks mainly focus on closed-domain settings with pred…
Reward-SQL: Boosting Text-to-SQL via Stepwise Execution-Aware Reasoning and Process-Supervised Rewards
Yuxin Zhang, Meihao Fan, Ju Fan +5
Recent advances in large language models (LLMs) trained with reinforcement learning (RL) have improved Text-to-SQL performance. However, RL-based approaches still struggle with com…
DataEvolver: Automatic Data Preparation for Large Language Models through Multi-Level Self-Evolving
Chao Deng, Shaolei Zhang, Ju Fan +1
High-quality training data is essential to large language models (LLMs) and typically requires extensive and costly manual curation. Existing automatic data preparation methods rel…
DeepPrep: An LLM-Powered Agentic System for Autonomous Data Preparation
Meihao Fan, Ju Fan, Yuxin Zhang +7
Data preparation, which aims to transform heterogeneous and noisy raw tables into analysis-ready data, remains a major bottleneck in data science. Recent approaches leverage large…