Reverse Modeling in Large Language Models

Sicheng Yu, Yuanchen Xu, Cunxiao Du +5

Humans are accustomed to reading and writing in a forward manner, and this natural bias extends to text understanding in auto-regressive large language models (LLMs). This paper in…