CARROT: A Learned Cost-Constrained Retrieval Optimization System for RAG

Ziting Wang, Haitao Yuan, Wei Dong +2

Large Language Models (LLMs) have demonstrated impressive ability in generation and reasoning tasks but struggle with handling up-to-date knowledge, leading to inaccuracies or hall…