Cmprsr: Abstractive Token-Level Question-Agnostic Prompt Compressor

Ivan Zakazov, Berke Argin, Oussama Gabouj +6

Motivated by the high costs of using black-box Large Language Models (LLMs), we introduce a novel prompt compression paradigm, under which we use smaller LLMs to compress inputs fo…