12 citations · 18 across the 8 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.LG2024
Improving the Validity and Practical Usefulness of AI/ML Evaluations Using an Estimands Framework
Olivier Binette, Jerome P. Reiter
Commonly, AI or machine learning (ML) models are evaluated on benchmark datasets. This practice supports innovative methodological research, but benchmark performance can be poorly…
cs.CL2024
How to Evaluate Entity Resolution Systems: An Entity-Centric Framework with Application to Inventor Name Disambiguation
Olivier Binette, Youngsoo Baek, Siddharth Engineer +3
Entity resolution (record linkage, microclustering) systems are notoriously difficult to evaluate. Looking for a needle in a haystack, traditional evaluation methods use sophistica…