Lifelong Object Detection
arXiv:2009.01129
Abstract
Recent advances in object detection have benefited significantly from rapid developments in deep neural networks. However, neural networks suffer from the well-known issue of catastrophic forgetting, which makes continual or lifelong learning problematic. In this paper, we leverage the fact that new training classes arrive in a sequential manner and incrementally refine the model so that it additionally detects new object classes in the absence of previous training data. Specifically, we consider the representative object detector, Faster R-CNN, for both accurate and efficient prediction. To prevent abrupt performance degradation due to catastrophic forgetting, we propose to apply knowledge distillation on both the region proposal network and the region classification network, to retain the detection of previously trained classes. A pseudo-positive-aware sampling strategy is also introduced for distillation sample selection. We evaluate the proposed method on PASCAL VOC 2007 and MS COCO benchmarks and show competitive mAP and 6x inference speed improvement, which makes the approach more suitable for real-time applications. Our implementation will be publicly available.
References in corpus (10)
- Distilling the Knowledge in a Neural Network
- Playing Atari with Deep Reinforcement Learning
- Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigence
- Continual Learning Through Synaptic Intelligence
- An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks
- PathNet: Evolution Channels Gradient Descent in Super Neural Networks
- Variational Continual Learning
- Overcoming Catastrophic Forgetting by Incremental Moment Matching
- Generative replay with feedback connections as a general strategy for continual learning
- An Implementation of Faster RCNN with Study for Region Sampling