Continual learning with the neural tangent ensemble

Ari S. Benjamin, Christian Pehle, Kyle Daruwalla

A natural strategy for continual learning is to weigh a Bayesian ensemble of fixed functions. This suggests that if a (single) neural network could be interpreted as an ensemble, o…