The Strong Pull of Prior Knowledge in Large Language Models and Its Impact on Emotion Recognition

Abstract

In-context Learning (ICL) has emerged as a powerful paradigm for performing natural language tasks with Large Language Models (LLM) without updating the models' parameters, in contrast to the traditional gradient-based finetuning. The promise of ICL is that the LLM can adapt to perform the present task at a competitive or state-of-the-art level at a fraction of the cost. The ability of LLMs to perform tasks in this few-shot manner relies on their background knowledge of the task (or task priors). However, recent work has found that, unlike traditional learning, LLMs are unable to fully integrate information from demonstrations that contrast task priors. This can lead to performance saturation at suboptimal levels, especially for subjective tasks such as emotion recognition, where the mapping from text to emotions can differ widely due to variability in human annotations. In this work, we design experiments and propose measurements to explicitly quantify the consistency of proxies of LLM priors and their pull on the posteriors. We show that LLMs have strong yet inconsistent priors in emotion recognition that ossify their predictions. We also find that the larger the model, the stronger these effects become. Our results suggest that caution is needed when using ICL with larger LLMs for affect-centered tasks outside their pre-training domain and when interpreting ICL results.

30 pages, 27 figures

References in corpus (11)

• Training language models to follow instructions with human feedback
• LLaMA: Open and Efficient Foundation Language Models
• Llama 2: Open Foundation and Fine-Tuned Chat Models
• Tree of Thoughts: Deliberate Problem Solving with Large Language Models
• Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
• Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Models
• Universal and Transferable Adversarial Attacks on Aligned Language Models
• Fine-tuning language models to find agreement among humans with diverse preferences
• Whose Opinions Do Language Models Reflect?
• Larger language models do in-context learning differently
• Health-LLM: Large Language Models for Health Prediction via Wearable Sensor Data