Data Quality over Capacity: Internalizing Documents into LoRA Adapters for Closed-Book QA

Joan Figuerola Hurtado

We study baking documents directly into the weights of a 4-bit Gemma-4-e4b model via LoRA, so a system can answer questions about a corpus closed-book: no retrieval and no context-…