DKL: Decoupled Knowledge Learning for Instruction-Tuned Language Models

Kushagra Bhushan, Meghanadh Pulivarthi, Sai Krishna Reddy Sathi +7

RAG has become the de facto method for incorporating new, corpus-specific knowledge into an instruction following LLM (Instruct LLM). Although RAG-based prompting improves factual…