Memory-Efficient Policy Libraries with Low-Rank Adaptation in Reinforcement Learning

Samuel Valland Lyngset, Tor Viljen Raanaas, Gard Sveipe +4

When fine-tuning Large Language Models (LLMs), there has been success in minimizing both memory usage and computation with Parameter-Efficient Fine-Tuning (PEFT), like Low Rank Ada…