9 citations · 19 across the 12 of their papers we have counts for
3 papers · 1 filter
HARDEN: Constrained Evolutionary Search for Harder, Answer-Preserving Evaluation Cases
Aditya Kumaran, Rahul Singhal, Karime Maamari +2
Language models are often evaluated on curated benchmarks that underrepresent the complexity of enterprise deployments. We introduce HARDEN, a constrained evolutionary search metho…
Factorized and Vectorized Execution: Optimizing Analytical and Semantic Queries over Relations
Sunny Yasser, Anas Dorbani, Amine Mhedhbi
Many-to-many joins are central to analytical and semantic workloads such as fraud detection, network analysis, and recommendation, where insights arise from relationships between e…
SQLMorph: Query Mutation and Fine-Grained Metrics for Text-to-SQL Evaluation
Mohammadhossein Malekpour, Mohamed Riahi, Maxime Lamothe +1
Text-to-SQL systems translate natural language queries into executable SQL, democratizing access to structured data. Despite recent advances driven by large language models (LLMs),…