55 citations · 55 across the 2 of their papers we have counts for
2 papers
cs.NE2022★ 55 cited
Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic Environments
Abhiram Iyer, Karan Grewal, Akash Velu +3
A key challenge for AI is to build embodied systems that operate in dynamically changing environments. Such systems must adapt to changing task contexts and learn continuously. Alt…
cs.LG2021
Two Sparsities Are Better Than One: Unlocking the Performance Benefits of Sparse-Sparse Networks
Kevin Lee Hunter, Lawrence Spracklen, Subutai Ahmad
In principle, sparse neural networks should be significantly more efficient than traditional dense networks. Neurons in the brain exhibit two types of sparsity; they are sparsely i…