Self-Supervised Position Debiasing for Large Language Models

Zhongkun Liu, Zheng Chen, Mengqi Zhang +3

Fine-tuning has been demonstrated to be an effective method to improve the domain performance of large language models (LLMs). However, LLMs might fit the dataset bias and shortcut…