Effect of Spherical Parameter Space on Number of Non-Forgetting Tasks and Capacity of Continual Learning

Nazanin Mirhosseini

We propose a continuous learning formulation for $T$ non-forgetting tasks with the spherical parameter space ${\mathbb{S}}^{d-1}(\sqrt{d})$ in asymptotic regime $d\to \infty$…