Architecture-driven Shift: towards a lightweight selector for capturing the trends of logit shift

Zhong Ye, Yu Hu, Ruilin Tang

Continual Learning (CL) is a practical paradigm to utilize power of deep pre-trained neural networks, but which pre-trained model has a better ability to balance ``Plasticity-Stabi…