Learning a Single Token to Replace Long System Prompts in LLMs

Jiancheng Dong, Pengyue Jia, Jingyu Peng +7

Long system prompts are widely used to steer Large Language Models (LLMs), but repeatedly processing them at inference time is inefficient and consumes valuable context budget. Thi…