92 citations · 120 across the 7 of their papers we have counts for
9 papers
Counter-GAP: Counterfactual Bias Evaluation through Gendered Ambiguous Pronouns
Zhongbin Xie, Vid Kocijan, Thomas Lukasiewicz +1
Bias-measuring datasets play a critical role in detecting biased behavior of language models and in evaluating progress of bias mitigation methods. In this work, we focus on evalua…
The Defeat of the Winograd Schema Challenge
Vid Kocijan, Ernest Davis, Thomas Lukasiewicz +2
The Winograd Schema Challenge - a set of twin sentences involving pronoun reference disambiguation that seem to require the use of commonsense knowledge - was proposed by Hector Le…
Few-Shot Out-of-Domain Transfer Learning of Natural Language Explanations in a Label-Abundant Setup
Yordan Yordanov, Vid Kocijan, Thomas Lukasiewicz +1
Training a model to provide natural language explanations (NLEs) for its predictions usually requires the acquisition of task-specific NLEs, which is time- and resource-consuming.…
Knowledge Base Completion Meets Transfer Learning
Vid Kocijan, Thomas Lukasiewicz
The aim of knowledge base completion is to predict unseen facts from existing facts in knowledge bases. In this work, we introduce the first approach for transfer of knowledge from…
The Gap on GAP: Tackling the Problem of Differing Data Distributions in Bias-Measuring Datasets
Vid Kocijan, Oana-Maria Camburu, Thomas Lukasiewicz
Diagnostic datasets that can detect biased models are an important prerequisite for bias reduction within natural language processing. However, undesired patterns in the collected…
Does the Objective Matter? Comparing Training Objectives for Pronoun Resolution
Yordan Yordanov, Oana-Maria Camburu, Vid Kocijan +1
Hard cases of pronoun resolution have been used as a long-standing benchmark for commonsense reasoning. In the recent literature, pre-trained language models have been used to obta…
A Review of Winograd Schema Challenge Datasets and Approaches
Vid Kocijan, Thomas Lukasiewicz, Ernest Davis +2
The Winograd Schema Challenge is both a commonsense reasoning and natural language understanding challenge, introduced as an alternative to the Turing test. A Winograd schema is a…
WikiCREM: A Large Unsupervised Corpus for Coreference Resolution
Vid Kocijan, Oana-Maria Camburu, Ana-Maria Cretu +3
Pronoun resolution is a major area of natural language understanding. However, large-scale training sets are still scarce, since manually labelling data is costly. In this work, we…
A Surprisingly Robust Trick for Winograd Schema Challenge
Vid Kocijan, Ana-Maria Cretu, Oana-Maria Camburu +2
The Winograd Schema Challenge (WSC) dataset WSC273 and its inference counterpart WNLI are popular benchmarks for natural language understanding and commonsense reasoning. In this p…