10 citations · 10 across the 1 of their papers we have counts for
2 papers
cs.LG2021★ 10 cited
Training Networks in Null Space of Feature Covariance for Continual Learning
Shipeng Wang, Xiaorong Li, Jian Sun +1
In the setting of continual learning, a network is trained on a sequence of tasks, and suffers from catastrophic forgetting. To balance plasticity and stability of network in conti…
cs.LG2018
HyperAdam: A Learnable Task-Adaptive Adam for Network Training
Shipeng Wang, Jian Sun, Zongben Xu
Deep neural networks are traditionally trained using human-designed stochastic optimization algorithms, such as SGD and Adam. Recently, the approach of learning to optimize network…