43 citations · 48 across the 5 of their papers we have counts for
6 papers
Debiasing should be Good and Bad: Measuring the Consistency of Debiasing Techniques in Language Models
Robert Morabito, Jad Kabbara, Ali Emami
Debiasing methods that seek to mitigate the tendency of Language Models (LMs) to occasionally output toxic or inappropriate text have recently gained traction. In this paper, we pr…
An Application of Pseudo-Log-Likelihoods to Natural Language Scoring
Darren Abramson, Ali Emami
Language models built using semi-supervised machine learning on large corpora of natural language have very quickly enveloped the fields of natural language generation and understa…
An Analysis of Dataset Overlap on Winograd-Style Tasks
Ali Emami, Adam Trischler, Kaheer Suleman +1
The Winograd Schema Challenge (WSC) and variants inspired by it have become important benchmarks for common-sense reasoning (CSR). Model performance on the WSC has quickly progress…
How Reasonable are Common-Sense Reasoning Tasks: A Case-Study on the Winograd Schema Challenge and SWAG
Paul Trichelair, Ali Emami, Adam Trischler +2
Recent studies have significantly improved the state-of-the-art on common-sense reasoning (CSR) benchmarks like the Winograd Schema Challenge (WSC) and SWAG. The question we ask in…
The Knowref Coreference Corpus: Removing Gender and Number Cues for Difficult Pronominal Anaphora Resolution
Ali Emami, Paul Trichelair, Adam Trischler +3
We introduce a new benchmark for coreference resolution and NLI, Knowref, that targets common-sense understanding and world knowledge. Previous coreference resolution tasks can lar…
A Knowledge Hunting Framework for Common Sense Reasoning
Ali Emami, Noelia De La Cruz, Adam Trischler +2
We introduce an automatic system that achieves state-of-the-art results on the Winograd Schema Challenge (WSC), a common sense reasoning task that requires diverse, complex forms o…