Online Deep Learning: Learning Deep Neural Networks on the Fly

Doyen Sahoo, Quang Pham, Jing Lu +1

Deep Neural Networks (DNNs) are typically trained by backpropagation in a batch learning setting, which requires the entire training data to be made available prior to the learning…