Sustaining Plasticity via Learnable Wavelet Activations in Continual Learning

Zeyang Zhang, Tieliang Gong, Junyan Lu +1

Plasticity loss has emerged as a critical challenge in continual learning that significantly hinders the acquisition of sequential tasks. While optimizing activation designs offers…