Natural Mitigation of Catastrophic Interference: Continual Learning in Power-Law Learning Environments

Atith Gandhi, Raj Sanjay Shah, Vijay Marupudi +1

Neural networks often suffer from catastrophic interference (CI): performance on previously learned tasks drops off significantly when learning a new task. This contrasts strongly…