2 papers
cs.NE2025
Reinitializing weights vs units for maintaining plasticity in neural networks
J. Fernando Hernandez-Garcia, Shibhansh Dohare, Jun Luo +1
Loss of plasticity is a phenomenon in which a neural network loses its ability to learn when trained for an extended time on non-stationary data. It is a crucial problem to overcom…
cs.LG2024
Maintaining Plasticity in Deep Continual Learning
Shibhansh Dohare, J. Fernando Hernandez-Garcia, Parash Rahman +2
Modern deep-learning systems are specialized to problem settings in which training occurs once and then never again, as opposed to continual-learning settings in which training occ…