Reactivation: Empirical NTK Dynamics Under Task Shifts

Yuzhi Liu, Zixuan Chen, Zirui Zhang +2

The Neural Tangent Kernel (NTK) offers a powerful tool to study the functional dynamics of neural networks. In the so-called lazy, or kernel regime, the NTK remains static during t…