510 citations · 998 across the 19 of their papers we have counts for
8 papers · 1 filter
Contrastive Perplexity for Controlled Generation: An Application in Detoxifying Large Language Models
Tassilo Klein, Moin Nabi
The generation of toxic content by large language models (LLMs) remains a critical challenge for the safe deployment of language technology. We propose a novel framework for implic…
miCSE: Mutual Information Contrastive Learning for Low-shot Sentence Embeddings
Tassilo Klein, Moin Nabi
This paper presents miCSE, a mutual information-based contrastive learning framework that significantly advances the state-of-the-art in few-shot sentence embedding. The proposed a…
SCD: Self-Contrastive Decorrelation for Sentence Embeddings
Tassilo Klein, Moin Nabi
In this paper, we propose Self-Contrastive Decorrelation (SCD), a self-supervised approach. Given an input sentence, it optimizes a joint self-contrastive and decorrelation objecti…
Attention-based Contrastive Learning for Winograd Schemas
Tassilo Klein, Moin Nabi
Self-supervised learning has recently attracted considerable attention in the NLP community for its ability to learn discriminative features using a contrastive objective. This pap…
Towards Zero-shot Commonsense Reasoning with Self-supervised Refinement of Language Models
Tassilo Klein, Moin Nabi
Can we get existing language models and refine them for zero-shot commonsense reasoning? This paper presents an initial study exploring the feasibility of zero-shot commonsense rea…
Contrastive Self-Supervised Learning for Commonsense Reasoning
Tassilo Klein, Moin Nabi
We propose a self-supervised method to solve Pronoun Disambiguation and Winograd Schema Challenge problems. Our approach exploits the characteristic structure of training corpora r…
Learning to Answer by Learning to Ask: Getting the Best of GPT-2 and BERT Worlds
Tassilo Klein, Moin Nabi
Automatic question generation aims at the generation of questions from a context, with the corresponding answers being sub-spans of the given passage. Whereas, most of the methods…
Attention Is (not) All You Need for Commonsense Reasoning
Tassilo Klein, Moin Nabi
The recently introduced BERT model exhibits strong performance on several language understanding benchmarks. In this paper, we describe a simple re-implementation of BERT for commo…