7 citations · 7 across the 9 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
cs.CL2024
Attributing Culture-Conditioned Generations to Pretraining Corpora
Huihan Li, Arnav Goel, Keyu He +1
In open-ended generative tasks like narrative writing or dialogue, large language models often exhibit cultural biases, showing limited knowledge and generating templated outputs f…
cs.LG2024
Demystifying Language Model Forgetting with Low-rank Example Associations
Xisen Jin, Xiang Ren
Large language models (LLMs) suffer from forgetting of upstream knowledge when fine-tuned. Despite efforts on mitigating forgetting, few have investigated how forgotten upstream ex…
cs.LG2024
What Will My Model Forget? Forecasting Forgotten Examples in Language Model Refinement
Xisen Jin, Xiang Ren
Language models deployed in the wild make errors. However, simply updating the model with the corrected error instances causes catastrophic forgetting -- the updated model makes er…