Word Embeddings Are Steers for Language Models

Chi Han, Jialiang Xu, Manling Li +5

Language models (LMs) automatically learn word embeddings during pre-training on language corpora. Although word embeddings are usually interpreted as feature vectors for individua…