367 citations · 427 across the 8 of their papers we have counts for
6 papers · 1 filter
SCD: Self-Contrastive Decorrelation for Sentence Embeddings
Tassilo Klein, Moin Nabi
In this paper, we propose Self-Contrastive Decorrelation (SCD), a self-supervised approach. Given an input sentence, it optimizes a joint self-contrastive and decorrelation objecti…
Attention-based Contrastive Learning for Winograd Schemas
Tassilo Klein, Moin Nabi
Self-supervised learning has recently attracted considerable attention in the NLP community for its ability to learn discriminative features using a contrastive objective. This pap…
Towards Zero-shot Commonsense Reasoning with Self-supervised Refinement of Language Models
Tassilo Klein, Moin Nabi
Can we get existing language models and refine them for zero-shot commonsense reasoning? This paper presents an initial study exploring the feasibility of zero-shot commonsense rea…
Contrastive Self-Supervised Learning for Commonsense Reasoning
Tassilo Klein, Moin Nabi
We propose a self-supervised method to solve Pronoun Disambiguation and Winograd Schema Challenge problems. Our approach exploits the characteristic structure of training corpora r…
Learning to Answer by Learning to Ask: Getting the Best of GPT-2 and BERT Worlds
Tassilo Klein, Moin Nabi
Automatic question generation aims at the generation of questions from a context, with the corresponding answers being sub-spans of the given passage. Whereas, most of the methods…
Attention Is (not) All You Need for Commonsense Reasoning
Tassilo Klein, Moin Nabi
The recently introduced BERT model exhibits strong performance on several language understanding benchmarks. In this paper, we describe a simple re-implementation of BERT for commo…