Every Time I Hire a Linguist, Inference Costs Go Down: On Linguistic Rules as Effective Prompt Compressors

Jianfei Ma, Zhaoxin Feng, Emmanuele Chersoni +1

The paper explores using deterministic linguistic rules as prompt compressors to shorten inputs for large language models, eliminating the need for costly model-based token scoring…