Discrete Prompt Compression with Reinforcement Learning

Hoyoun Jung, Kyung-Joong Kim

Compressed prompts aid instruction-tuned language models (LMs) in overcoming context window limitations and reducing computational costs. Existing methods, which primarily based on…