2 papers
cs.CL2026
Understanding Data Temporality Impact on Large Language Models Pre-training
Hippolyte Pilchen, Romain Fabre, Franck Signe Talla +2
Large language models (LLMs) are typically trained on shuffled corpora, yielding models whose knowledge is frozen at train time and whose temporal grounding remains poorly understo…
cs.CL2024
Neutral Residues: Revisiting Adapters for Model Extension
Franck Signe Talla, Edouard Grave, Hervé Jégou
We address the problem of extending a pretrained large language model to a new domain that was not seen during training. Standard techniques, such as finetuning or low-rank adaptat…