Permutation Invariant Learning with High-Dimensional Particle Filters

Akhilan Boopathy, Aneesh Muppidi, Peggy Yang +3

Sequential learning in deep models often suffers from challenges such as catastrophic forgetting and loss of plasticity, largely due to the permutation dependence of gradient-based…