Statistical mechanics of continual learning: variational principle and mean-field potential

Chan Li, Zhenye Huang, Wenxuan Zou +1

An obstacle to artificial general intelligence is set by continual learning of multiple tasks of different nature. Recently, various heuristic tricks, both from machine learning an…