12 citations · 18 across the 8 of their papers we have counts for
8 papers
Improving the Validity and Practical Usefulness of AI/ML Evaluations Using an Estimands Framework
Olivier Binette, Jerome P. Reiter
Commonly, AI or machine learning (ML) models are evaluated on benchmark datasets. This practice supports innovative methodological research, but benchmark performance can be poorly…
How to Evaluate Entity Resolution Systems: An Entity-Centric Framework with Application to Inventor Name Disambiguation
Olivier Binette, Youngsoo Baek, Siddharth Engineer +3
Entity resolution (record linkage, microclustering) systems are notoriously difficult to evaluate. Looking for a needle in a haystack, traditional evaluation methods use sophistica…
Optimal -score Clustering for Bipartite Record Linkage
Eric A. Bai, Olivier Binette, Jerome P. Reiter
Probabilistic record linkage is often used to match records from two files, in particular when the variables common to both files comprise imperfectly measured identifiers like nam…
PatentsView-Evaluation: Evaluation Datasets and Tools to Advance Research on Inventor Name Disambiguation
Olivier Binette, Sarvo Madhavan, Jack Butler +3
We present PatentsView-Evaluation, a Python package that enables researchers to evaluate the performance of inventor name disambiguation systems such as PatentsView.org. The packag…
Estimating the Performance of Entity Resolution Algorithms: Lessons Learned Through PatentsView.org
Olivier Binette, Sokhna A York, Emma Hickerson +3
This paper introduces a novel evaluation methodology for entity resolution algorithms. It is motivated by PatentsView.org, a U.S. Patents and Trademarks Office patent data explorat…
On the Reliability of Multiple Systems Estimation for the Quantification of Modern Slavery
Olivier Binette, Rebecca C. Steorts
The quantification of modern slavery has received increased attention recently as organizations have come together to produce global estimates, where multiple systems estimation (M…
(Almost) All of Entity Resolution
Olivier Binette, Rebecca C. Steorts
Whether the goal is to estimate the number of people that live in a congressional district, to estimate the number of individuals that have died in an armed conflict, or to disambi…
A Note on Reverse Pinsker Inequalities
Olivier Binette
A simple method is shown to provide optimal variational bounds on -divergences with possible constraints on relative information extremums. Known results are refined or proved t…