Learning What to Remember: Test-Time Training via Context Distillation

Zixuan Wang, Xingyu Dang, Rui-Jie Zhu +4

Effective long-context modeling is not merely about retaining more of the past, but about preserving the information that may prove relevant later. Test-time training (TTT) is an a…