Identifying the Source of Generation for Large Language Models

Bumjin Park, Jaesik Choi

Large language models (LLMs) memorize text from several sources of documents. In pretraining, LLM trains to maximize the likelihood of text but neither receives the source of the t…