Sequence-Level Leakage Risk of Training Data in Large Language Models

Trishita Tiwari, G. Edward Suh

This work quantifies the risk of training data leakage from LLMs (Large Language Models) using sequence-level probabilities. Computing extraction probabilities for individual seque…