Showing cs.LGShow all
2 papers · 1 filter
cs.LG2024
Long Context RAG Performance of Large Language Models
Quinn Leng, Jacob Portes, Sam Havens +2
Retrieval Augmented Generation (RAG) has emerged as a crucial technique for enhancing the accuracy of Large Language Models (LLMs) by incorporating external information. With the a…
cs.LG2024
LoRA Learns Less and Forgets Less
Dan Biderman, Jacob Portes, Jose Javier Gonzalez Ortiz +9
Low-Rank Adaptation (LoRA) is a widely-used parameter-efficient finetuning method for large language models. LoRA saves memory by training only low rank perturbations to selected w…