24 citations · 25 across the 3 of their papers we have counts for
3 papers
Evaluating Cost-Accuracy Trade-offs in Multimodal Search Relevance Judgements
Silvia Terragni, Hoang Cuong, Joachim Daiber +2
Large Language Models (LLMs) have demonstrated potential as effective search relevance evaluators. However, there is a lack of comprehensive guidance on which models consistently p…
Evaluating Entity Disambiguation and the Role of Popularity in Retrieval-Based NLP
Anthony Chen, Pallavi Gudipati, Shayne Longpre +2
Retrieval is a core component for open-domain NLP tasks. In open-domain tasks, multiple entities can share a name, making disambiguation an inherent yet under-explored problem. We…
Overton: A Data System for Monitoring and Improving Machine-Learned Products
Christopher Ré, Feng Niu, Pallavi Gudipati +1
We describe a system called Overton, whose main design goal is to support engineers in building, monitoring, and improving production machine learning systems. Key challenges engin…