9 citations · 9 across the 3 of their papers we have counts for
5 papers
The Validity of Coreference-based Evaluations of Natural Language Understanding
Ian Porada
In this thesis, I refine our understanding as to what conclusions we can reach from coreference-based evaluations by expanding existing evaluation practices and considering the ext…
Solving the Challenge Set without Solving the Task: On Winograd Schemas as a Test of Pronominal Coreference Resolution
Ian Porada, Jackie Chi Kit Cheung
Challenge sets such as the Winograd Schema Challenge (WSC) are used to benchmark systems' ability to resolve ambiguities in natural language. If one assumes as in existing work tha…
A Controlled Reevaluation of Coreference Resolution Models
Ian Porada, Xiyuan Zou, Jackie Chi Kit Cheung
All state-of-the-art coreference resolution (CR) models involve finetuning a pretrained language model. Whether the superior performance of one CR model over another is due to the…
Modeling Event Plausibility with Consistent Conceptual Abstraction
Ian Porada, Kaheer Suleman, Adam Trischler +1
Understanding natural language requires common sense, one aspect of which is the ability to discern the plausibility of events. While distributional models -- most recently pre-tra…
Can a Gorilla Ride a Camel? Learning Semantic Plausibility from Text
Ian Porada, Kaheer Suleman, Jackie Chi Kit Cheung
Modeling semantic plausibility requires commonsense knowledge about the world and has been used as a testbed for exploring various knowledge representations. Previous work has focu…