FlashBack: Efficient Retrieval-Augmented Language Modeling for Fast Inference

Runheng Liu, Xingchen Xiao, Heyan Huang +2

Retrieval-Augmented Language Modeling (RALM) by integrating large language models (LLM) with relevant documents from an external corpus is a proven method for enabling the LLM to g…