Prompt Compression via Activation Aggregation

Thibaud Ardoin, Semira Einsele, Evis Bregu +1

Large language models process prompts by propagating activations through dozens of layers before generating a response. We ask whether the task-relevant information contained in an…