63 citations · 143 across the 9 of their papers we have counts for
3 papers · 1 filter
Metrology for AI: From Benchmarks to Instruments
Chris Welty, Praveen Paritosh, Lora Aroyo
In this paper we present the first steps towards hardening the science of measuring AI systems, by adopting metrology, the science of measurement and its application, and applying…
What is Fair? Exploring Pareto-Efficiency for Fairness Constrained Classifiers
Ananth Balashankar, Alyssa Lees, Chris Welty +1
The potential for learned models to amplify existing societal biases has been broadly recognized. Fairness-aware classifier constraints, which apply equality metrics of performance…
A Crowdsourced Frame Disambiguation Corpus with Ambiguity
Anca Dumitrache, Lora Aroyo, Chris Welty
We present a resource for the task of FrameNet semantic frame disambiguation of over 5,000 word-sentence pairs from the Wikipedia corpus. The annotations were collected using a nov…