5 papers
Cheaper, Better, Faster, Stronger: Robust Text-to-SQL without Chain-of-Thought or Fine-Tuning
Yusuf Denizay Dönder, Derek Hommel, Andrea W Wen-Yi +2
LLMs are effective at code generation tasks like text-to-SQL, but is it worth the cost? Many state-of-the-art approaches use non-task-specific LLM techniques including Chain-of-Tho…
Are LLMs Overkill for Databases?: A Study on the Finiteness of SQL
Yue Li, David Mimno, Unso Eun Seo Jo
Translating natural language to SQL for data retrieval has become more accessible thanks to code generation LLMs. But how hard is it to generate SQL code? While databases can becom…
Agent Bain vs. Agent McKinsey: A New Text-to-SQL Benchmark for the Business Domain
Yue Li, Ran Tao, Derek Hommel +4
Text-to-SQL benchmarks have traditionally only tested simple data access as a translation task of natural language to SQL queries. But in reality, users tend to ask diverse questio…
Show or Tell? Modeling the evolution of request-making in Human-LLM conversations
Shengqi Zhu, Jeffrey M. Rzeszotarski, David Mimno
Designing user-centered LLM systems requires understanding how people use them, but patterns of user behavior are often masked by the variability of queries. In this work, we intro…
Large Language Models in Qualitative Research: Uses, Tensions, and Intentions
Hope Schroeder, Marianne Aubin Le Quéré, Casey Randazzo +2
Qualitative researchers use tools to collect, sort, and analyze their data. Should qualitative researchers use large language models (LLMs) as part of their practice? LLMs could au…