Lightweight Chunk Selection for Mobile Retrieval-Augmented Generation

Sicong Chang, Yidan Shen, Wen Yu +3

RAG improves the factual grounding of LLM by incorporating external knowledge, but deploying RAG on mobile and edge devices remains challenging because retrieved context increases…