3 papers
cs.CL2025
How much do language models memorize?
John X. Morris, Chawin Sitawarin, Chuan Guo +5
We propose a new method for estimating how much a model knows about a datapoint and use it to measure the capacity of modern language models. Prior studies of language model memori…
cs.LG2025
Measuring Déjà vu Memorization Efficiently
Narine Kokhlikyan, Bargav Jayaraman, Florian Bordes +2
Recent research has shown that representation learning models may accidentally memorize their training data. For example, the déjà vu method shows that for certain representation…
cs.CV2024
Déjà Vu Memorization in Vision-Language Models
Bargav Jayaraman, Chuan Guo, Kamalika Chaudhuri
Vision-Language Models (VLMs) have emerged as the state-of-the-art representation learning solution, with myriads of downstream applications such as image classification, retrieval…