5 citations · 10 across the 4 of their papers we have counts for
4 papers
k-Rater Reliability: The Correct Unit of Reliability for Aggregated Human Annotations
Ka Wong, Praveen Paritosh
Since the inception of crowdsourcing, aggregation has been a common strategy for dealing with unreliable data. Aggregate ratings are more reliable than individual ones. However, ma…
Cross-replication Reliability -- An Empirical Approach to Interpreting Inter-rater Reliability
Ka Wong, Praveen Paritosh, Lora Aroyo
We present a new approach to interpreting IRR that is empirical and contextualized. It is based upon benchmarking IRR against baseline measures in a replication, one of which is a…
Wiki-Reliability: A Large Scale Dataset for Content Reliability on Wikipedia
KayYen Wong, Miriam Redi, Diego Saez-Trumper
Wikipedia is the largest online encyclopedia, used by algorithms and web users as a central hub of reliable information on the web. The quality and reliability of Wikipedia content…
Contextual Neural Machine Translation Improves Translation of Cataphoric Pronouns
KayYen Wong, Sameen Maruf, Gholamreza Haffari
The advent of context-aware NMT has resulted in promising improvements in the overall translation quality and specifically in the translation of discourse phenomena such as pronoun…