activity
20212026
most citedCorrecting Negative Bias in Large Language Models through Negative Attention Score Alignment

2 citations · 3 across the 12 of their papers we have counts for

collaborators
Showing 2021Show all

1 paper · 1 filter

cs.CL2021

Rare Tokens Degenerate All Tokens: Improving Neural Text Generation via Adaptive Gradient Gating for Rare Token Embeddings

Sangwon Yu, Jongyoon Song, Heeseung Kim +3

Recent studies have determined that the learned token embeddings of large-scale neural language models are degenerated to be anisotropic with a narrow-cone shape. This phenomenon,…