PerCache: Predictive Hierarchical Cache for RAG Applications on Mobile Devices

Kaiwei Liu, Liekang Zeng, Lilin Xu +2

Retrieval-augmented generation (RAG) has become a de facto paradigm in various large language model (LLM)-driven applications on mobile devices, such as mobile assistants leveragin…