4 papers
Residual Skill Optimization for Text-to-SQL Ensembles
Jiongli Zhu, Haoquan Guan, Parjanya Prajakta Prashant +8
Text-to-SQL ensembles improve over single-candidate generation by drawing multiple SQL candidates and selecting one, but their effectiveness is bounded by Pass@K, the probability t…
Towards Robust Offline Evaluation: A Causal and Information Theoretic Framework for Debiasing Ranking Systems
Seyedeh Baharan Khatami, Sayan Chakraborty, Ruomeng Xu +1
Evaluating retrieval-ranking systems is crucial for developing high-performing models. While online A/B testing is the gold standard, its high cost and risks to user experience req…
Scalable Out-of-distribution Robustness in the Presence of Unobserved Confounders
Parjanya Prashant, Seyedeh Baharan Khatami, Bruno Ribeiro +1
We consider the task of out-of-distribution (OOD) generalization, where the distribution shift is due to an unobserved confounder () affecting both the covariates () and the…
Graph Machine Learning based Doubly Robust Estimator for Network Causal Effects
Seyedeh Baharan Khatami, Harsh Parikh, Haowei Chen +2
We address the challenge of inferring causal effects in social network data. This results in challenges due to interference -- where a unit's outcome is affected by neighbors' trea…