conformal inference 1extractable memorization 1large language models 1privacy evaluation 1statistical testing 1
From the 1 of 3 linked papers with an AI index.
3 papers
cs.LG2026
Extractable Memorization From First Principles
A. Feder Cooper, Marika Swanberg, Jamie Hayes +5
The paper introduces formal matched‑comparison methods—using conformal testing and document‑level censuses—to reliably determine when a language model has memorized training data,…
cs.LG2025
Machine Unlearning Doesn't Do What You Think: Lessons for Generative AI Policy and Research
A. Feder Cooper, Christopher A. Choquette-Choo, Miranda Bogen +34
"Machine unlearning" is a popular proposed solution for mitigating the existence of content in an AI model that is problematic for legal or moral reasons, including privacy, copyri…
cs.CL2025
UQ: Assessing Language Models on Unsolved Questions
Fan Nie, Ken Ziyu Liu, Zihao Wang +11
Benchmarks shape progress in AI research. A useful benchmark should be both difficult and realistic: questions should challenge frontier models while also reflecting real-world usa…