Less is More: Lightweight Prompt Compression for Question Answering Applications on Edge Devices

Zihuai Xu, Ruofei Hou, Yang Xu +3

In agent-driven question answering (QA) applications, retrieval-augmented generation (RAG) is commonly introduced to enhance the response accuracy of large language models (LLMs) b…