Dynamic Compressing Prompts for Efficient Inference of Large Language Models

Jinwu Hu, Wei Zhang, Yufeng Wang +4

Large Language Models (LLMs) have shown outstanding performance across a variety of tasks, partly due to advanced prompting techniques. However, these techniques often require leng…