29 citations · 151 across the 40 of their papers we have counts for
4 papers · 1 filter
Moving Beyond Downstream Task Accuracy for Information Retrieval Benchmarking
Keshav Santhanam, Jon Saad-Falcon, Martin Franz +7
Neural information retrieval (IR) systems have progressed rapidly in recent years, in large part due to the release of publicly available benchmarking tasks. Unfortunately, some di…
A Closer Look at the Calibration of Differentially Private Learners
Hanlin Zhang, Xuechen Li, Prithviraj Sen +2
We systematically study the calibration of classifiers trained with differentially private stochastic gradient descent (DP-SGD) and observe miscalibration across a wide range of vi…
Synthetic Target Domain Supervision for Open Retrieval QA
Revanth Gangi Reddy, Bhavani Iyer, Md Arafat Sultan +5
Neural passage retrieval is a new and promising approach in open retrieval question answering. In this work, we stress-test the Dense Passage Retriever (DPR) -- a state-of-the-art…
A Benchmark for Generalizable and Interpretable Temporal Question Answering over Knowledge Bases
Sumit Neelam, Udit Sharma, Hima Karanam +22
Knowledge Base Question Answering (KBQA) tasks that involve complex reasoning are emerging as an important research direction. However, most existing KBQA datasets focus primarily…