Towards Understanding Systems Trade-offs in Retrieval-Augmented Generation Model Inference

Michael Shen, Muhammad Umar, Kiwan Maeng +2

The rapid increase in the number of parameters in large language models (LLMs) has significantly increased the cost involved in fine-tuning and retraining LLMs, a necessity for kee…