ContextFocus: Activation Steering for Contextual Faithfulness in Large Language Models

Nikhil Anand, Shwetha Somasundaram, Anirudh Phukan +2

Large Language Models (LLMs) encode vast amounts of parametric knowledge during pre-training. As world knowledge evolves, effective deployment increasingly depends on their ability…