Decoupling Knowledge and Privacy: Post-Task Self-Distillation Replay for LLM Continual Learning

Shengtao Wen, Yunying Yang, Xiang Chen +3

Privacy-preserving continual learning (PPCL) must reduce the reproduction of sensitive content while retaining useful knowledge across sequential tasks. Formal privacy guarantees c…