Beyond Frequency: The Role of Redundancy in Large Language Model Memorization

Jie Zhang, Qinghua Zhao, Chi-ho Lin +2

Memorization in large language models poses critical risks for privacy and fairness as these systems scale to billions of parameters. While previous studies established correlation…